-- Logs begin at Mon 2022-07-25 18:23:52 UTC, end at Mon 2022-07-25 19:37:44 UTC. -- Jul 25 19:04:00.001822 dv-cinder-850939-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 19:04:00.010936 dv-cinder-850939-1-smb devstack@keystone.service[80497]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 19:04:00 2022] *** Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: nodename: dv-cinder-850939-1-smb Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: machine: x86_64 Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: clock source: unix Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: pcre jit disabled Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: detected number of CPU cores: 4 Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: current working directory: / Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: detected binary path: /usr/bin/uwsgi-core Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: your processes number limit is 47680 Jul 25 19:04:00.013045 dv-cinder-850939-1-smb devstack@keystone.service[80497]: your memory page size is 4096 bytes Jul 25 19:04:00.013724 dv-cinder-850939-1-smb devstack@keystone.service[80497]: detected max file descriptor number: 2048 Jul 25 19:04:00.013724 dv-cinder-850939-1-smb devstack@keystone.service[80497]: lock engine: pthread robust mutexes Jul 25 19:04:00.013837 dv-cinder-850939-1-smb devstack@keystone.service[80497]: thunder lock: enabled Jul 25 19:04:00.014090 dv-cinder-850939-1-smb devstack@keystone.service[80497]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 19:04:00.014090 dv-cinder-850939-1-smb devstack@keystone.service[80497]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 19:04:00.053935 dv-cinder-850939-1-smb devstack@keystone.service[80497]: Python main interpreter initialized at 0x55fdff0aa9c0 Jul 25 19:04:00.053935 dv-cinder-850939-1-smb devstack@keystone.service[80497]: python threads support enabled Jul 25 19:04:00.053935 dv-cinder-850939-1-smb devstack@keystone.service[80497]: your server socket listen backlog is limited to 100 connections Jul 25 19:04:00.053935 dv-cinder-850939-1-smb devstack@keystone.service[80497]: your mercy for graceful operations on workers is 90 seconds Jul 25 19:04:00.054341 dv-cinder-850939-1-smb devstack@keystone.service[80497]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 19:04:00.054341 dv-cinder-850939-1-smb devstack@keystone.service[80497]: *** Operational MODE: preforking *** Jul 25 19:04:00.054670 dv-cinder-850939-1-smb devstack@keystone.service[80497]: *** uWSGI is running in multiple interpreter mode *** Jul 25 19:04:00.054670 dv-cinder-850939-1-smb devstack@keystone.service[80497]: spawned uWSGI master process (pid: 80497) Jul 25 19:04:00.054898 dv-cinder-850939-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 19:04:00.057248 dv-cinder-850939-1-smb devstack@keystone.service[80497]: spawned uWSGI worker 1 (pid: 80507, cores: 1) Jul 25 19:04:00.057248 dv-cinder-850939-1-smb devstack@keystone.service[80497]: spawned uWSGI worker 2 (pid: 80508, cores: 1) Jul 25 19:04:00.057248 dv-cinder-850939-1-smb devstack@keystone.service[80497]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 19:04:05.463085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:04:05.463085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: from cryptography.utils import int_from_bytes Jul 25 19:04:05.463913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:04:05.463913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: from cryptography.utils import int_from_bytes Jul 25 19:04:05.514968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:04:05.515152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:04:05.515336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] command line args: [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:04:05.515608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:04:05.515788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ================================================================================ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:04:05.516046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] admin_token = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.516293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] config_dir = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.516481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.516666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] config_source = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.516845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] debug = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.517049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.517579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.517679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.517875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.518126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.518358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.518541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_config_append = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.518722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.518929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_dir = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.519081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.519319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.519569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.519818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.520068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.520249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.520429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.520676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.520929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.521192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.521436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.521669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.521907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.522156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.522404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.522681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.523186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.113/identity {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.523369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] publish_errors = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.523601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.523833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.524012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.524261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.524497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.524732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] standard_threads = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.524964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.525240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.525421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.525598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] use_journal = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.525778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] use_json = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.525954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] use_stderr = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.526132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] use_syslog = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.526364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.526627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.526870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.527130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.527372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.527622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.527862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.528111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.528383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.528629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.528878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.529159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.529395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.529644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.529881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.530131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.530380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.530621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.530878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.531139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.531389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.531626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.531882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.532146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.532402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.532652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.532886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.533135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.533378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.533616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.533868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.534116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.534349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.534582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.534829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.535083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.535317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.535566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.535807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.536075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.536310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.536496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.536761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.536990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.537248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.537486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.537736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.537969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.538210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.538434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.538662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.538897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.539146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.539377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.539602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.539846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.540080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.540317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.540557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.540788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.541047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.541310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.541550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.541776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:04:05.541776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: from cryptography.utils import int_from_bytes Jul 25 19:04:05.542313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.542313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.542432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:04:05.542432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: from cryptography.utils import int_from_bytes Jul 25 19:04:05.542532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.542532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.542733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.542944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.543217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.543461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.543716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.544043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.544287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.544527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.544768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.545018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.545285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.545527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.545772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.546014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.546253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.546490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.546730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.546968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.547234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.547479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.547726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.547967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.548210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.548449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.548688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.548927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.549182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.549424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.549656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.549891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.550123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.550366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.550604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.550855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.551100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.551358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.551622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.551866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.552101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.external = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.552334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.552634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.552870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.553104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.password = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.553360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.token = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.553604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.553844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.554093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.554327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.554575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.554825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.555058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.555298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.555543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.555795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.556044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.556285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.556533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.556770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.557024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.557301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.557542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.557796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.558085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.558336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.558603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.558851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.559109 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.559346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.559709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.559868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.560117 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.560353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.560604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.560847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.561112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.561374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.561634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.561875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.562128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.562367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.562619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.562869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.563111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.563350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.563602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.563836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.564078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.564329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.564585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.564819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.565053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.565318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.565565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.565813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.566061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.566318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.566566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.566838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.567089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.567330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.568943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.569197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.569451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.569702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.569940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.590454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:04:05.590683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:04:05.590885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] command line args: [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:04:05.591151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:04:05.591306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ================================================================================ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:04:05.591564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] admin_token = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.591921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config_dir = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.592056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.592135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] config_source = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.592295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] debug = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.592506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.592767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.592920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.593232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.593477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.593705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.593854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_config_append = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.594059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.594184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_dir = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.594392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.594629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.594858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.595087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.595329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.595501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.595675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.595937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.596180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.596413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.596641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.596872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.597100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.597373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.597614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.597888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.598426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.113/identity {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.598623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] publish_errors = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.598873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.599104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.599278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.599520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.599754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.599988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] standard_threads = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.600456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.600625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.600809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_journal = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.600968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_json = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.601173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_stderr = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.601354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] use_syslog = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.601570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:04:05.601843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.602079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.602338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.602562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.602886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.603145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.603270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.603504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.603746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.603988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.604236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.604467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.604710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.604941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.605210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.605458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.605693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.605944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.606280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.606591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.606882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.607342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.607342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.607662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.608095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.608331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.608558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.608787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.609021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.609299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.609544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.609770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.610002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.610243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.610485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.610719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.610962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.611194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.611425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.611657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.611883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.612110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.612337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.612565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.612799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.613044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.613310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.613549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.613777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.614013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.614246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.614498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.614728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.614965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.615201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.615435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.615668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.615904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.616130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.616375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.616608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.616844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.617072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.617380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.617617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.617845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.618074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.618309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.618578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.618815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.619060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.619308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.619541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.619773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.620008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.620256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.620491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.620726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.620964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.621224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.621460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.621692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.621953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.622187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.622528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.622528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.623108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.623108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.623359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.623593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.623842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.624076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.624306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.624536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.624765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.624998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.625252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.625495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.625729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.625976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.626212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.626464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.626726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.627015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.627194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.external = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.627428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.627722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.627953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.628182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.password = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.628409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.token = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.628647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.628882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.629168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.629378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.629638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.629863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.630091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.630318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.630566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.630815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.631054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.631292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.631530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.631759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.632019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.632270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.632506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.632755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.633042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.633314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.633574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.633814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.634066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.634299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.634534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.634778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.635022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.635249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.635492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.635728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.635978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.636212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.636465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.636699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.636944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.637203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.637448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.637851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.638750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.638991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.639243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.639475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.639713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.639960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.640213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.640450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.640679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.640908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.641175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.641439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.641683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.641937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.642183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.642477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.642715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.642952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.643184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.643420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.643646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.643879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.644126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.644365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.644615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.644842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.649763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.650756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.651000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.651261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.651508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.651750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.651956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.652210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.652440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.652692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.652928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.653209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.653450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.653849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.654159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.654521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.654768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.655000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.655214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.655469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.655706 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.655941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.656174 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.656416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.656660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.656894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.657165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.657396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.657637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.657872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.658105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.658339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.658581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.658818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.659047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.659281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.659517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.659762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.660986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.661982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.662957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.663919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.664981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.665973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.666935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.667974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.668958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.669653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.669745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.669841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.669918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.669990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.670971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.671972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.672942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.673959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.674932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.675946 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] role.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.676899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] role.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.677896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.678856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679109 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.679929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:04:05.680031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.680284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.680728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.680972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.681257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.681515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.681769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.682028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.682269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.682532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.682792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.683039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.683278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.683516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.683751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.684011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.684274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.684690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.684865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.685034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.685300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.685544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.685786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.686040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.686280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.686543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.686798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.687043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.687295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.687542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.687796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.688041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.688285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.688525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.688777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.689031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.689292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.689542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.689824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.690092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.690342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.690595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.690838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.691089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.691339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.691579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.691821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.692062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.692311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.692553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.692804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.693044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.693326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.693562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.693810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.694045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.694288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.694526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:04:05.694700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:04:05.710582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.710817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.711048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.719433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.719675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.719913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.720422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.728796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.752182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.752390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.756351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.756595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.805732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.806522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.856127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.856484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.859279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.859574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.924565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.924749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.924872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.925827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.926053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.926272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.949257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.949486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.949628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.949712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.949921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.950070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.950206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.950351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.950447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.951042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.951220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.951296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.951371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.951371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.962401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.962581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.975744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.975972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.976845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.977002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.977195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.977195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.977456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:04:05.994871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.995061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:04:05.995407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.995555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.995631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:04:05.995707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:04:05.995981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996174 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:04:05.996285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.996948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:05.997228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.007743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.008023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.008186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.008288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.008504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.008588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.008768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.009043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.016756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.017480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.020157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.020441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.020722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.020813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.020992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.021895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.022925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.023107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.023366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.049829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.051405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.051536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.051754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.053030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.053323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.057078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.057392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.057678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.058564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.058958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.059237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.065338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.065627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.066670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.066950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.070182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.070479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.070763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.071041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.071309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.071511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.071638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.071798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.071924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.072045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.072135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.072352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.072622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.072885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.073151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.073427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.090972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.091272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.092436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.092698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.095814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.097319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.099440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.099708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.100980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.101549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.104852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.106535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.108796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.110457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.112979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.113308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.113597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.113885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.114042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.114198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.114362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.114489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.114612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.114920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.115188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.115466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.134695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.134986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.135238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.135399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.135489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.135564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.135796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.136035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.143672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.144167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.145423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.145717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.145944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.146224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.148921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.149228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.149353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.149506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.149632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.149786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.149939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.150032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.150239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.150602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.163812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.164102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.164250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.164386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.164467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.164666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.164925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.165958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.183762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.183960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.187065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.187201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.190395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.190635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.192008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.192267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.193801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.193952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.194078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.194226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.194386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.194517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.201758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.202479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.203385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.204096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.206623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.206916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.207188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.207313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.207432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.207611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.207998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.208266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.216742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.217052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.217354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.217555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.217834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.218183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.225152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.225478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.225755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.225969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:04:06.226096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.226242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.226369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.226501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.226612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.226792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.226919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.227034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.227200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.227287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.227440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.227688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.227923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.228936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.229052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.229291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.229550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:04:06.266978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fdff0aa9c0 pid: 80507 (default app) Jul 25 19:04:06.267907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fdff0aa9c0 pid: 80508 (default app) Jul 25 19:04:06.270641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42a91-3785-4912-aad4-69e769fb9d92 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:06.270938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42a91-3785-4912-aad4-69e769fb9d92 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:06.271218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42a91-3785-4912-aad4-69e769fb9d92 None None] PATH_INFO: `/v3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:06.275490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1/1] 10.222.0.113 () {50 vars in 796 bytes} [Mon Jul 25 19:04:06 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:14.100410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:14.101331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:14.101331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:14.108764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1/2] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:14 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:14.114648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:14.115150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:14.115272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:14.189320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: INFO dbcounter [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] Registered counter for database keystone Jul 25 19:04:14.212477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:04:14.221871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writer thread running {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:04:14.404376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG passlib.handlers.bcrypt [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80507) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 19:04:14.404794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG passlib.handlers.bcrypt [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80507) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 19:04:14.460196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:14.461909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:14.597243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 2/3] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:14 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 19:04:14.736417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:14.807711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: INFO dbcounter [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] Registered counter for database keystone Jul 25 19:04:14.828518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG oslo_db.sqlalchemy.engines [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:04:14.838678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writer thread running {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:04:14.971586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b7e4-1d98-49c1-b633-56ad448a7895 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:14.976359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:14.977055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:14.977730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:14.977730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:14.990825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:15.045310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 19:04:15.045651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae8bc-d3c5-461c-983c-b9421bf4fc53 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:15.057206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 2/4] 10.222.0.113 () {58 vars in 1329 bytes} [Mon Jul 25 19:04:14 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:04:15.063640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:15.079197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9725c3-f4d9-4698-9aaa-2a8ad276cc45 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:15.084375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:15.085544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:15.085825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:15.086095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] PATH_INFO: `/v3/projects/b55401b6f7164ec1b40688c01754b91f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:15.087661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] RBAC: Authorizing `identity:get_project(project_id=b55401b6f7164ec1b40688c01754b91f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:15.141688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 19:04:15.142375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0448d49-c03a-40fc-b623-48909f4f129b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:15.147029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 3/5] 10.222.0.113 () {56 vars in 1212 bytes} [Mon Jul 25 19:04:15 2022] GET /identity/v3/projects/b55401b6f7164ec1b40688c01754b91f => generated 345 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:17.226929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f08fe-69fc-4949-ab16-4c1d4fcfddc3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:17.227507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f08fe-69fc-4949-ab16-4c1d4fcfddc3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:17.227507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f08fe-69fc-4949-ab16-4c1d4fcfddc3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:17.233440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 3/6] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:17 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:17.241849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:17.242566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:17.242733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:17.267514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:17.269031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:17.278382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 4/7] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:17 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 19:04:17.305182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f08fe-69fc-4949-ab16-4c1d4fcfddc3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:17.320667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f08fe-69fc-4949-ab16-4c1d4fcfddc3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:17.325365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e3e48-7a66-473b-a7a8-5d996ecdf634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:17.326023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3e48-7a66-473b-a7a8-5d996ecdf634 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:17.326319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3e48-7a66-473b-a7a8-5d996ecdf634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:17.326611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3e48-7a66-473b-a7a8-5d996ecdf634 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:17.335367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e3e48-7a66-473b-a7a8-5d996ecdf634 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:17.337210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e3e48-7a66-473b-a7a8-5d996ecdf634 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:17.347237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 4/8] 10.222.0.113 () {58 vars in 1329 bytes} [Mon Jul 25 19:04:17 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:04:17.353419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:17.366292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1496a-ca96-40a1-aff3-20f7af0fcdce None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:17.372909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cda4c1-818e-408e-a1f6-ec72f7037a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:17.373863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda4c1-818e-408e-a1f6-ec72f7037a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:17.374146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda4c1-818e-408e-a1f6-ec72f7037a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:17.374422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda4c1-818e-408e-a1f6-ec72f7037a6f admin admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:17.376016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cda4c1-818e-408e-a1f6-ec72f7037a6f admin admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:17.377927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cda4c1-818e-408e-a1f6-ec72f7037a6f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:17.379618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 5/9] 10.222.0.113 () {56 vars in 1203 bytes} [Mon Jul 25 19:04:17 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:19.492463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2b10f-47dc-4eee-8d76-4ca40b165940 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:19.493179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f60d-eadd-4f9d-bd9c-290db129a614 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:19.493179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f60d-eadd-4f9d-bd9c-290db129a614 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:19.493634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2b10f-47dc-4eee-8d76-4ca40b165940 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:19.493722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f60d-eadd-4f9d-bd9c-290db129a614 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:19.493817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2b10f-47dc-4eee-8d76-4ca40b165940 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:19.494442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 6/10] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:19.494577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 5/11] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:19.500155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:19.500649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aab31-7280-4481-a854-fbdffc05810c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:19.500771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:19.500852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aab31-7280-4481-a854-fbdffc05810c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:19.500933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:19.501027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aab31-7280-4481-a854-fbdffc05810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:19.525670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:19.526868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:19.548045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG passlib.handlers.bcrypt [None req-487aab31-7280-4481-a854-fbdffc05810c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80508) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 19:04:19.548428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG passlib.handlers.bcrypt [None req-487aab31-7280-4481-a854-fbdffc05810c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80508) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 19:04:19.595155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-487aab31-7280-4481-a854-fbdffc05810c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:19.596784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-487aab31-7280-4481-a854-fbdffc05810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:19.618334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 7/12] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:19.640442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:19.666360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:19.707864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 6/13] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:19.731372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aab31-7280-4481-a854-fbdffc05810c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:19.765609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725ae35-0a75-4c76-84d3-b464c7dc8741 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:19.803733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:19.804401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:19.804682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:19.804954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:19.849840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aab31-7280-4481-a854-fbdffc05810c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:19.852280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:19.885226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:19.886788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:19.894752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:19.895857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:19.896152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:19.896434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:19.909179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:19.913725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:19.921151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:19.922298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:19.923273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 7/14] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:19.930121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:20.004345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 8/15] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:20.013146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:20.037805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897798-62e5-4944-bbea-9a96073db4c0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:20.072675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:20.073480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:20.073666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:20.073941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:20.074757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:20.075064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:20.076533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:20.089149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 8/16] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:20.094954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:20.114868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec75d-2024-4fcc-b14b-44d18402c93d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:20.127879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:20.141622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:20.154036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:20.154770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:20.155051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:20.155333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:20.166139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:20.167645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:04:20.189207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:20.190179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:20.190962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:04:20.190962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:04:20.190962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:04:20.190962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:20.190962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 9/17] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:20.196320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:20.210333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcf3ea-fb26-41ab-8c44-30cf635928a1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:20.247375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:20.248336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:20.248621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:20.248902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:20.250591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:20.252090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:20.253807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 9/18] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:20 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:20.259319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:20.308588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c86288-bc14-449c-a986-0a29580e2782 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:20.347388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:20.348125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:20.348409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:20.348688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:20.349456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:20.349768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:20.351230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:20.368734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:20.369989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 10/19] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:04:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:20.378125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849cbb-b1e3-495f-aa24-e21e9f756c0a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:20.427702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b25eb5-316e-42d7-b826-52e2a5e3c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:20.428505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b25eb5-316e-42d7-b826-52e2a5e3c29c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:20.428790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b25eb5-316e-42d7-b826-52e2a5e3c29c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:20.429066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b25eb5-316e-42d7-b826-52e2a5e3c29c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:20.430528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b25eb5-316e-42d7-b826-52e2a5e3c29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:20.432066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b25eb5-316e-42d7-b826-52e2a5e3c29c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:20.433962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 10/20] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:20.440283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:20.480730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:20.560981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d25b-c143-4c11-98bf-10a0334f6063 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:20.605542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:20.606850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:20.608127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:20.608127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:20.609252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.domain.id=default, user.id=a8b8b54dcb4240b68176774c2828e299) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:20.609252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:20.610409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44361ba4-4e4b-43e9-b93b-837a3f11f8a0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:20.618544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 11/21] 10.222.0.113 () {56 vars in 1327 bytes} [Mon Jul 25 19:04:20 2022] GET /identity/v3/role_assignments?user.id=a8b8b54dcb4240b68176774c2828e299&scope.domain.id=default&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 234 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:23.028122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508bcc-7f8d-45e7-adc7-6de2b4b7022c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.028122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508bcc-7f8d-45e7-adc7-6de2b4b7022c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.028803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508bcc-7f8d-45e7-adc7-6de2b4b7022c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.029874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 11/22] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:23.035359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15f1-6201-43bb-864e-e931a386cdb4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.035841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15f1-6201-43bb-864e-e931a386cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.036040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15f1-6201-43bb-864e-e931a386cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.066801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dbcf15f1-6201-43bb-864e-e931a386cdb4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:23.068050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dbcf15f1-6201-43bb-864e-e931a386cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:23.068528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166ccfc-07e3-4cc6-a35c-4e8bbb23ea54 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.068807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166ccfc-07e3-4cc6-a35c-4e8bbb23ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.069090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166ccfc-07e3-4cc6-a35c-4e8bbb23ea54 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.070481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 12/23] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:04:23.076369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e10b-e8cd-4a05-be7a-41578984f557 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.076653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e10b-e8cd-4a05-be7a-41578984f557 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.076925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283e10b-e8cd-4a05-be7a-41578984f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.112250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3283e10b-e8cd-4a05-be7a-41578984f557 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:23.114274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3283e10b-e8cd-4a05-be7a-41578984f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:23.235452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 12/24] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:23.236867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 13/25] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:23.257938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b9da-60dd-486e-9a19-44e9bcca8c85 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.258255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b9da-60dd-486e-9a19-44e9bcca8c85 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.258505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b9da-60dd-486e-9a19-44e9bcca8c85 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.260036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 13/26] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:23.266511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.266812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.266969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b9da-60dd-486e-9a19-44e9bcca8c85 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:23.267076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.299295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:23.300394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:23.336999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:23.460827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 14/27] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:23.463573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:23.513847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b9da-60dd-486e-9a19-44e9bcca8c85 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:23.521473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:23.620445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6bbd9-2ce6-4435-8be4-200b7ec5778e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:23.624493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:23.625609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.626038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.626454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.640866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:23.651163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:23.652270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:23.653155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:23.655197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 14/28] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:23.661056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:23.663530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78044b-f945-458e-8940-38d8e60d88a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:23.664220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78044b-f945-458e-8940-38d8e60d88a1 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.664502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78044b-f945-458e-8940-38d8e60d88a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.664778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78044b-f945-458e-8940-38d8e60d88a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.665587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78044b-f945-458e-8940-38d8e60d88a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:23.667190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78044b-f945-458e-8940-38d8e60d88a1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:23.779770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:23.796497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268674-7f03-4184-b2ef-ce8d6bee926f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:23.838582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:23.839695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.840328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.840776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.854419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:23.856428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-cb3e24a6-a6d2-410b-aaeb-16424295eb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:04:23.879351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:23.880717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:23.881740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:04:23.881740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:04:23.881740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:04:23.881740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:23.883365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 15/29] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:23.884853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3fb4c-6b24-4abc-9415-aabcfbca9062 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.885308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3fb4c-6b24-4abc-9415-aabcfbca9062 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.885740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3fb4c-6b24-4abc-9415-aabcfbca9062 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.887277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 16/30] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:23.888316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3fb4c-6b24-4abc-9415-aabcfbca9062 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:23.939880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 15/31] 10.222.0.113 () {60 vars in 1136 bytes} [Mon Jul 25 19:04:23 2022] POST /identity/v3/roles => generated 220 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:23.941654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:23.941958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:23.942244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:23.963461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:23.965218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:24.035048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3fb4c-6b24-4abc-9415-aabcfbca9062 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.077678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.078377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.078665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.078941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.079712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:24.080163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.081742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073e43-1938-4646-ba3a-c1cc58009dcc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.090145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 16/32] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:24.093932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.117030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 17/33] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:24.118748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380abc74-22ba-4f01-bfb9-cd4393859839 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.119042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380abc74-22ba-4f01-bfb9-cd4393859839 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.119321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380abc74-22ba-4f01-bfb9-cd4393859839 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.120956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 18/34] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:24.122434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380abc74-22ba-4f01-bfb9-cd4393859839 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.130464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:24.134193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:24.265635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87a89-5b60-4142-9a7d-16b40fea19cf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.271632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380abc74-22ba-4f01-bfb9-cd4393859839 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.306557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.307254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.307529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.307814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.308598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:24.309086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.310820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a5530-e9db-4a4d-9d98-75eadf64af18 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.323559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.324533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.324817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.325091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.326487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.328053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.334242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 19/35] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:24 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:24.334242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.345166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 17/36] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:04:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:24.345166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.345166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.345166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.365266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:24.366608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:24.416097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:24.447925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 18/37] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:24.450532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.453997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:24.454855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e624b-9714-4884-b1ae-991d4a982b66 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.492250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5edcc-73cb-4613-80de-7a4a3c053a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.492934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5edcc-73cb-4613-80de-7a4a3c053a6d None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.493261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5edcc-73cb-4613-80de-7a4a3c053a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.493541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5edcc-73cb-4613-80de-7a4a3c053a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.494302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5edcc-73cb-4613-80de-7a4a3c053a6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.495739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5edcc-73cb-4613-80de-7a4a3c053a6d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.562052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf63ec-1d62-4271-856a-bdf382629488 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.609830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.610657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.610949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.611239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.612636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.614217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.615985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 19/38] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:24 2022] GET /identity/v3/domains/default => generated 200 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:24.616799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.693983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:24.734751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 20/39] 10.222.0.113 () {60 vars in 1136 bytes} [Mon Jul 25 19:04:24 2022] POST /identity/v3/roles => generated 226 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:24.736335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dcc81-eff7-4b42-aad8-e26fcc034d9a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.736626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dcc81-eff7-4b42-aad8-e26fcc034d9a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.736900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dcc81-eff7-4b42-aad8-e26fcc034d9a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.737515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59f1d8-2986-450e-bfd7-2fcf62f3d0e3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.738448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 21/40] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:24.738963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dcc81-eff7-4b42-aad8-e26fcc034d9a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.796850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.797919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.798233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.798701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.799959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.802621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.857903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 20/41] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:04:24 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:24.858619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:24.888158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dcc81-eff7-4b42-aad8-e26fcc034d9a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:24.926853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:24.941349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30ca3-b293-4d85-8d05-b133bef7d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:24.942453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30ca3-b293-4d85-8d05-b133bef7d0a9 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.942947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30ca3-b293-4d85-8d05-b133bef7d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.943464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30ca3-b293-4d85-8d05-b133bef7d0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:24.944318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d30ca3-b293-4d85-8d05-b133bef7d0a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:24.947092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d30ca3-b293-4d85-8d05-b133bef7d0a9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:24.968817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 22/42] 10.222.0.113 () {60 vars in 1136 bytes} [Mon Jul 25 19:04:24 2022] POST /identity/v3/roles => generated 224 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:24.975487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:24.977247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:24.977861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:25.015328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:25.019570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:25.025578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afab1a-c4ca-4978-ad75-58782d7114c5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:25.065902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:25.089826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:25.090866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:25.091401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:25.091474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] PATH_INFO: `/v3/domains/default/users/a8b8b54dcb4240b68176774c2828e299/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:25.094144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a8b8b54dcb4240b68176774c2828e299, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:25.095617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:25.124919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 21/43] 10.222.0.113 () {58 vars in 1366 bytes} [Mon Jul 25 19:04:24 2022] PUT /identity/v3/domains/default/users/a8b8b54dcb4240b68176774c2828e299/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:25.160339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 23/44] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:25.197834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:25.364350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd24dd-2a4e-4b93-a087-d2999b74ae27 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:25.410178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285fe8e-4c40-40a7-8f27-4120b0ac43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:25.411126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285fe8e-4c40-40a7-8f27-4120b0ac43ad None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:25.411409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285fe8e-4c40-40a7-8f27-4120b0ac43ad None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:25.411692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285fe8e-4c40-40a7-8f27-4120b0ac43ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:25.412913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285fe8e-4c40-40a7-8f27-4120b0ac43ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:25.414452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285fe8e-4c40-40a7-8f27-4120b0ac43ad None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:25.416157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 22/45] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:25.427699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:25.538603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694738b-a131-4877-a1e7-de091c489fd3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:25.560458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:25.578152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b4443-9ee7-4ee6-aed8-d82fdc61698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:25.578845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4443-9ee7-4ee6-aed8-d82fdc61698c None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:25.579130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4443-9ee7-4ee6-aed8-d82fdc61698c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:25.579407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4443-9ee7-4ee6-aed8-d82fdc61698c None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:25.580127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b4443-9ee7-4ee6-aed8-d82fdc61698c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:25.581685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b4443-9ee7-4ee6-aed8-d82fdc61698c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:25.614336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 24/46] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:04:25 2022] POST /identity/v3/projects => generated 313 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:27.179070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098717-8199-4bcf-9b31-8bb43bec88a0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.179614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098717-8199-4bcf-9b31-8bb43bec88a0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.179614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098717-8199-4bcf-9b31-8bb43bec88a0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.180974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 23/47] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:27.186837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.187315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.187528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.207584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:27.208796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:27.287543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 25/48] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:27.312129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098717-8199-4bcf-9b31-8bb43bec88a0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:27.372932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:27.432528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098717-8199-4bcf-9b31-8bb43bec88a0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:27.468314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e9fa7-347c-40a4-8b32-51f58a586739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:27.469143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9fa7-347c-40a4-8b32-51f58a586739 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.469452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9fa7-347c-40a4-8b32-51f58a586739 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.469730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e9fa7-347c-40a4-8b32-51f58a586739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.481393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e9fa7-347c-40a4-8b32-51f58a586739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e37e9fa7-347c-40a4-8b32-51f58a586739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:27.489646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:27.490538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:27.491290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:27.493304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 24/49] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:27.496876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:27.625404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59eb07-f251-4baf-abbe-abacdd4f9b2c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:27.627035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:27.659169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56e2d8-1ed5-473d-97f3-676222bba349 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.659464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56e2d8-1ed5-473d-97f3-676222bba349 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.659747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56e2d8-1ed5-473d-97f3-676222bba349 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.661168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 25/50] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:27.666289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:27.666703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.666974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.667074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.667257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.667350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.667531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.668325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:27.668631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:27.670345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:27.681605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 26/51] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:27.687333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:27.687534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:27.688652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:27.769354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 26/52] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:27.792241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:27.813810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73887f-a554-4784-9338-f4c245ba9529 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:27.837918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:27.854347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:27.855252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.855679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.856169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.858139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:27.859640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:27.861370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 27/53] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:27 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:27.868494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:27.904602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:27.916447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59525807-3588-4905-8e4a-f4962b8037b2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:27.951787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:27.952514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:27.952777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:27.953295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:27.954501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:27.955962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:27.957658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 27/54] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:27.965461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:27.983409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c1343-9310-4727-a754-6f3a90bbdfad None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:28.018899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:28.019706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:28.019989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:28.020259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:28.021497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:28.022945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:28.024765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 28/55] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:28.030394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:28.083339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7774ac3-c90e-41ee-ac68-e6a38d1c4356 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:28.092829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:28.126307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dcce4-3148-4120-af6b-b5f179146dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:28.127285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dcce4-3148-4120-af6b-b5f179146dfc None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:28.127736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dcce4-3148-4120-af6b-b5f179146dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:28.128118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dcce4-3148-4120-af6b-b5f179146dfc None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:28.129259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dcce4-3148-4120-af6b-b5f179146dfc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:28.131537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dcce4-3148-4120-af6b-b5f179146dfc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:28.141817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:28.145008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43582958-36c6-458a-9a55-827c431458e6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:28.169772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 28/56] 10.222.0.113 () {60 vars in 1145 bytes} [Mon Jul 25 19:04:27 2022] POST /identity/v3/projects => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:04:28.195572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:28.196279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:28.196562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:28.196841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:28.197744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.domain.id=default, user.id=a8b8b54dcb4240b68176774c2828e299) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:28.198117 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:28.199844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fede2-c14d-450e-8154-e27ba4689934 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:28.207405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 29/57] 10.222.0.113 () {56 vars in 1327 bytes} [Mon Jul 25 19:04:28 2022] GET /identity/v3/role_assignments?user.id=a8b8b54dcb4240b68176774c2828e299&scope.domain.id=default&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 532 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:30.462388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd258b-0b72-4120-bd6d-cf87dfcd812b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:30.462913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd258b-0b72-4120-bd6d-cf87dfcd812b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:30.462913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd258b-0b72-4120-bd6d-cf87dfcd812b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:30.464609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 29/58] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:30.471011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:30.471510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:30.471601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:30.492573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:30.493871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:30.567381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 30/59] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:30.594070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd258b-0b72-4120-bd6d-cf87dfcd812b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:30.711402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd258b-0b72-4120-bd6d-cf87dfcd812b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:30.766760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc499ded-07c7-4c1b-abb3-1ba0c397b67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:30.768019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499ded-07c7-4c1b-abb3-1ba0c397b67a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:30.768493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499ded-07c7-4c1b-abb3-1ba0c397b67a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:30.768952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499ded-07c7-4c1b-abb3-1ba0c397b67a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:30.770943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc499ded-07c7-4c1b-abb3-1ba0c397b67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:30.773345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc499ded-07c7-4c1b-abb3-1ba0c397b67a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:30.775844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 30/60] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:30.782026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:30.884416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:30.892245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6c49-ceff-4aae-92ca-576be7a4a1e1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:30.927405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea968775-e907-4d06-8171-90b60b6330c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:30.928089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968775-e907-4d06-8171-90b60b6330c2 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:30.928374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968775-e907-4d06-8171-90b60b6330c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:30.928655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea968775-e907-4d06-8171-90b60b6330c2 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:30.929412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea968775-e907-4d06-8171-90b60b6330c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:30.930890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea968775-e907-4d06-8171-90b60b6330c2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:30.960986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 31/61] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:04:30 2022] POST /identity/v3/users => generated 276 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:34.176698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7bcd4-80fb-4fcc-a930-823a96c909e4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.177778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7bcd4-80fb-4fcc-a930-823a96c909e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.178267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7bcd4-80fb-4fcc-a930-823a96c909e4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.179864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 31/62] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:34.186100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.187030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.187505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.211673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:34.213219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:34.287162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7e3b-85bb-413b-9952-29fe75ddd4f4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.288032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7e3b-85bb-413b-9952-29fe75ddd4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.288634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7e3b-85bb-413b-9952-29fe75ddd4f4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.290672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 32/63] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:34 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:04:34.298046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.298652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.299181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.321511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 32/64] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:34.334706 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:34.336265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:34.346226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:34.391838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:34.459776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:34.499642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5c007-18fb-42f9-89c8-99d9ea8f6df1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:34.504703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 33/65] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:34.527937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:34.602692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:34.603531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.603821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.604100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.641806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:34.643181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b8d7-02fd-4ec5-8ceb-a9c815bf8554 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:34.649765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:34.650730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:34.651480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 33/66] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:34.662929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:34.690145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:34.691906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.692367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.692779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.706572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:34.716139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:34.717044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:34.717832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:34.720074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 34/67] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:04:34.728909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:34.773488 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:34.853154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36222d0-bb5e-4e7e-b91f-e9345fc7430d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:34.869895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13768-d8cf-4bc0-ba24-fd1eb1841040 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:34.894214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:34.894911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.895196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.895478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.897993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:34.897993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:34.897993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698f2ba-4fd3-439f-9183-6c14175fd5e2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:34.907205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 34/68] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:34.908553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90fb7-39c0-4d80-93ba-07071236bfd4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.908848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90fb7-39c0-4d80-93ba-07071236bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.909149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90fb7-39c0-4d80-93ba-07071236bfd4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.910017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:34.910562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 35/69] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:34.910723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.910992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.911277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.911437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3109-0e3c-45d4-8dbf-811ef405f334 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.911787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3109-0e3c-45d4-8dbf-811ef405f334 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.912065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3109-0e3c-45d4-8dbf-811ef405f334 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.912150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:34.912419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:34.913540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 36/70] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:34 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:34.913901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad77fc5-2918-498e-9052-680c96762ab2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:34.915167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc8dd-7b50-4797-af8e-df6dd6483c0f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.915679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc8dd-7b50-4797-af8e-df6dd6483c0f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.916164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc8dd-7b50-4797-af8e-df6dd6483c0f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.917742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 37/71] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:34.918692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc8dd-7b50-4797-af8e-df6dd6483c0f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:34.924226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:34.924539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 35/72] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:34 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:34.926005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b799-da49-48e5-919f-775b87ffea99 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:34.926184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b799-da49-48e5-919f-775b87ffea99 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:34.926425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873b799-da49-48e5-919f-775b87ffea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:34.947888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c873b799-da49-48e5-919f-775b87ffea99 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:34.949223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c873b799-da49-48e5-919f-775b87ffea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:35.021951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 36/73] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:35.023274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.023564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.023860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.044291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:35.046204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:35.049472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc8dd-7b50-4797-af8e-df6dd6483c0f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.051476 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.086699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcf616-3fdb-44ba-b5c3-f45cd9192723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.087597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf616-3fdb-44ba-b5c3-f45cd9192723 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.087880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf616-3fdb-44ba-b5c3-f45cd9192723 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.088153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcf616-3fdb-44ba-b5c3-f45cd9192723 None admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.089466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcf616-3fdb-44ba-b5c3-f45cd9192723 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:35.090957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcf616-3fdb-44ba-b5c3-f45cd9192723 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:35.097185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 38/74] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:34 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:35.097185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.097185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.097185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.113822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:35.115111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:35.127132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 37/75] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:35.128180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.187456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.193237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 39/76] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:35.198621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.237814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e00fc-9bff-4d05-a636-9e7710be0f76 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.274277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.275101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.275387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.275662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.287672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.295496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:35.297052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:35.298866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 38/77] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:35.299662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.324214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529ea2c-8a3b-4832-9f0a-a7064c83ee99 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.359328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.360154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.360437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.360710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.371486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:35.379582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:35.380466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:35.381269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 40/78] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:35.381902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.422069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6522580-7d98-4cb9-af50-ee3829c67e9d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.444859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.457731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27326e46-f679-49a2-888c-86225108b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.458402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27326e46-f679-49a2-888c-86225108b84c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.458690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27326e46-f679-49a2-888c-86225108b84c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.458975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27326e46-f679-49a2-888c-86225108b84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.487351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207ceb-bae6-490d-8fb6-c72a86402e2d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.521134 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.521965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.522225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.522506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.527368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.533197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27326e46-f679-49a2-888c-86225108b84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:35.534701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27326e46-f679-49a2-888c-86225108b84c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:35.535314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:35.543266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:35.544196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:35.544991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 41/79] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:35.545658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.649098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 39/80] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:35.649992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27326e46-f679-49a2-888c-86225108b84c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.677371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38044f-3779-4251-9d69-9a3c3331634d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.698377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.714920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.717018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.717018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.717018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.717919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:35.719426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:35.721676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 42/81] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:35.721912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.759033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:35.762585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27326e46-f679-49a2-888c-86225108b84c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.799537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.800124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.800415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.800699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.835653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f353a-6aee-4d23-b708-bcdaaaa46c23 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:35.873231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:35.873968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:35.874258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:35.874459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:35.874560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:35.875303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:35.875616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:35.875965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:35.877017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:35.886827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 43/82] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:35.887868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:35.943907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.003292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.013021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 40/83] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:36.013021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.020729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fddf6-b656-47a4-bced-b3eea8f55f03 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.057904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.058825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.059153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.059500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.060263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:36.060556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.062040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.070965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 44/84] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.071804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.125101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8a214-fea2-49ff-9fca-41fe3e087cb4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.162247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.163201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.163486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.163766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.165047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.166565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.168766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 41/85] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.169610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.187874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4dde5-60cb-4b2a-ac06-f77733cc1fa2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.202100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.226831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.227536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.227814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.228097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.228828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.230950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.238304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.256169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 45/86] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:04:36 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:36.258588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.284944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318350f-9c68-4dbf-8f2d-0ada206f7400 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.333284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.334645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.335148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.335605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.337213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.338928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.341493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 42/87] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.342596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.407293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2d77-eca2-4031-9721-f6433e67a13f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.452186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.453113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.453422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.453703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.455489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.457030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.459266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 46/88] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.459658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.466534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a62c0-141a-4b5f-9994-c304d81097e4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.509230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.511088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.512132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.512365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.512651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.514461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.515988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.517673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 43/89] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.518558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.521506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.597147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc86cb9-754a-4c76-8e53-a6bb0bfbf2ce None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.649661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e46e-d5a4-4bab-9bdf-7b078ce5ea36 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.649859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.650421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.650715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.651001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.653180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=a8b8b54dcb4240b68176774c2828e299) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:36.653541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.655174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.663441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 47/90] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/role_assignments?user.id=a8b8b54dcb4240b68176774c2828e299&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.664467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.691082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23b34-337a-4761-a075-755729324d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.691936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23b34-337a-4761-a075-755729324d2e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.692231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23b34-337a-4761-a075-755729324d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.692513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23b34-337a-4761-a075-755729324d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.778238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d23b34-337a-4761-a075-755729324d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.779889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d23b34-337a-4761-a075-755729324d2e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.782401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.810280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:36.814562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787ee48-ff6c-46f3-a5e1-756b5e18907e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:36.871023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:36.871638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:36.871924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:36.872209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:36.873066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=2e90285b16a54207a853a3db25dd94f9) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:36.874943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:36.877420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:36.886434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 48/91] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/role_assignments?user.id=2e90285b16a54207a853a3db25dd94f9&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:36.888327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:36.924491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 44/92] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:36.935686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23b34-337a-4761-a075-755729324d2e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:37.122178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1617-790c-4c2d-a13e-f04e2d5e3f87 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:37.152202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23b34-337a-4761-a075-755729324d2e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:37.154374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:37.207475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:37.208291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:37.208585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:37.208865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:37.231091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:37.232366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:37.232794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:37.233077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:37.238078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:37.239668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:37.241719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 45/93] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:37.247960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:37.280997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:37.360620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:37.363117 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:37.463469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874f5e-b815-4f38-84c0-687fd662ad3c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:37.491929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 49/94] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:37.498714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:37.546941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:37.547628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:37.547911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:37.548184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:37.549045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] RBAC: Adding query filter params (role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=2e90285b16a54207a853a3db25dd94f9) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:37.549409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:37.550923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:37.563153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 46/95] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:37 2022] GET /identity/v3/role_assignments?user.id=2e90285b16a54207a853a3db25dd94f9&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 260 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:37.582647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:37.638604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23310912-a8e2-40c5-a252-f67f6c07a3e6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:37.703198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b995-c718-42bc-a67a-a1348eb72232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:37.704244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b995-c718-42bc-a67a-a1348eb72232 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:37.704440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b995-c718-42bc-a67a-a1348eb72232 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:37.704718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b995-c718-42bc-a67a-a1348eb72232 None admin] PATH_INFO: `/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:37.709979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5b995-c718-42bc-a67a-a1348eb72232 None admin] RBAC: Authorizing `identity:get_project(project_id=227f6f72ea72484e9e96ccd96fb09ca6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:37.711529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5b995-c718-42bc-a67a-a1348eb72232 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:37.713423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 50/96] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:37 2022] GET /identity/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6 => generated 313 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:37.720187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:37.769862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:37.905417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d97979-283b-4b58-8721-77ab0265b201 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:37.966242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:37.967308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:37.967797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:37.968270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:37.969778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=227f6f72ea72484e9e96ccd96fb09ca6, user.id=2e90285b16a54207a853a3db25dd94f9) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:37.970316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:37.972509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83755a83-79b2-43ba-8897-5b84fec4f9be None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:37.986090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 47/97] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:37 2022] GET /identity/v3/role_assignments?user.id=2e90285b16a54207a853a3db25dd94f9&scope.project.id=227f6f72ea72484e9e96ccd96fb09ca6&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:39.043293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d1629-d2ce-4cc8-af44-13465bff2595 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.044334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d1629-d2ce-4cc8-af44-13465bff2595 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.044817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d1629-d2ce-4cc8-af44-13465bff2595 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.046785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 51/98] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:39.053482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.054436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.054906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.086253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:39.087840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:39.179615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 48/99] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:39.218913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d1629-d2ce-4cc8-af44-13465bff2595 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:39.376713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d1629-d2ce-4cc8-af44-13465bff2595 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:39.426247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:39.431860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e0277-409a-41c0-aefe-287983d3180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:39.434098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0277-409a-41c0-aefe-287983d3180a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.434401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0277-409a-41c0-aefe-287983d3180a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.434685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0277-409a-41c0-aefe-287983d3180a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.451485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e0277-409a-41c0-aefe-287983d3180a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-781e0277-409a-41c0-aefe-287983d3180a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:39.459602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:39.460557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:39.461822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 52/100] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:39.467285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:39.499384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:39.511491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f1601-3829-4784-9286-ea37737ad2f8 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.512174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f1601-3829-4784-9286-ea37737ad2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.512667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f1601-3829-4784-9286-ea37737ad2f8 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.514426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 53/101] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:39.520205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.520794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.521545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.557563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:39.559212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:39.587186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fda1ff-3bb7-4ffe-8418-daf0b3aee027 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:39.640567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:39.641691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.642313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.643460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.645657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:39.647095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:39.650324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:39.683194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 49/102] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:39 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:39.689033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:39.770859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 54/103] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:39.809518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:39.810958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:39.817146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8975f-225b-442f-8db1-4d0d0cfd44fd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:39.853958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb9203-8856-4424-aa00-3a79399ccc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:39.856261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb9203-8856-4424-aa00-3a79399ccc34 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.856723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb9203-8856-4424-aa00-3a79399ccc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.857495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb9203-8856-4424-aa00-3a79399ccc34 None admin] PATH_INFO: `/v3/users/34f05faf10444648855c71613372075a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.873636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb9203-8856-4424-aa00-3a79399ccc34 None admin] RBAC: Authorizing `identity:get_user(user_id=34f05faf10444648855c71613372075a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:39.875452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb9203-8856-4424-aa00-3a79399ccc34 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:39.877667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 50/104] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:39 2022] GET /identity/v3/users/34f05faf10444648855c71613372075a => generated 290 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:39.879162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34f37-4da1-49d6-bcf0-1c835c2c93e4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:39.879769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34f37-4da1-49d6-bcf0-1c835c2c93e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:39.880242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34f37-4da1-49d6-bcf0-1c835c2c93e4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:39.881733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 51/105] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:39.884819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34f37-4da1-49d6-bcf0-1c835c2c93e4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:39.999014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34f37-4da1-49d6-bcf0-1c835c2c93e4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.020182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed7cd-a906-49b0-8fd1-38d4664399d0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.037304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.038259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.038833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.039286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.061505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.062674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.094493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101c5c5-50e4-48e1-8da6-3a165ce5edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.095332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101c5c5-50e4-48e1-8da6-3a165ce5edc1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.095797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101c5c5-50e4-48e1-8da6-3a165ce5edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.096219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101c5c5-50e4-48e1-8da6-3a165ce5edc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.119675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:40.122247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:40.123452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101c5c5-50e4-48e1-8da6-3a165ce5edc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9101c5c5-50e4-48e1-8da6-3a165ce5edc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:40.135894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:40.137759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:40.138522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 55/106] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:40.139153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130285-c4dc-4874-b4f4-b2830b045ff4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.139153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130285-c4dc-4874-b4f4-b2830b045ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.139153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130285-c4dc-4874-b4f4-b2830b045ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.174587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-61130285-c4dc-4874-b4f4-b2830b045ff4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:40.175820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-61130285-c4dc-4874-b4f4-b2830b045ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:40.249593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 52/107] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:40.250919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.279023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 56/108] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:40.287346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e240041-1718-4366-ab76-0703c2dd0f49 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.287999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e240041-1718-4366-ab76-0703c2dd0f49 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.288856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e240041-1718-4366-ab76-0703c2dd0f49 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.293266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 57/109] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:40 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:40.297438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e240041-1718-4366-ab76-0703c2dd0f49 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.340349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.409709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc0cd-5b7f-44e9-a718-28d2d83831ab None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.428404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e240041-1718-4366-ab76-0703c2dd0f49 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.443760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.459462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.460548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.461167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.461685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.462748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:40.463257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:40.465280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:40.467141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6aa9-10fd-464e-99e8-7a84fff2a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.468311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6aa9-10fd-464e-99e8-7a84fff2a4ce None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.468788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6aa9-10fd-464e-99e8-7a84fff2a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.469272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6aa9-10fd-464e-99e8-7a84fff2a4ce None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.470882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b6aa9-10fd-464e-99e8-7a84fff2a4ce None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:40.472721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b6aa9-10fd-464e-99e8-7a84fff2a4ce None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:40.474783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 58/110] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:40 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:40.475728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 53/111] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:40 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:40.476426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.476699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.477141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.477611 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.498058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:40.499743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:40.576542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 59/112] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:40.577822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.591548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af228c74-8704-4f93-b82a-d2fa093f0413 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.603638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.630778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.631695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.631882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.632144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.633374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:40.636685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:40.636814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 54/113] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:40.637761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.714156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b5852-603d-46bc-8910-f620c8b7a33c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.728374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.761883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.762098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6742-2078-4678-9b59-fd92a171dafb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.762519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.762802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.763073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.763912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] RBAC: Adding query filter params (role.id=dcf2d5aa453148329e20ffb9f2121223, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=34f05faf10444648855c71613372075a) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:40.764221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:40.765716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:40.781173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 60/114] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:40 2022] GET /identity/v3/role_assignments?user.id=34f05faf10444648855c71613372075a&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=dcf2d5aa453148329e20ffb9f2121223 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:40.781173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.813533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968b3e-7c2a-4ead-a9e9-513c1e3bb565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.814869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968b3e-7c2a-4ead-a9e9-513c1e3bb565 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.815426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968b3e-7c2a-4ead-a9e9-513c1e3bb565 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.815901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968b3e-7c2a-4ead-a9e9-513c1e3bb565 None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.817991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968b3e-7c2a-4ead-a9e9-513c1e3bb565 None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:40.820866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968b3e-7c2a-4ead-a9e9-513c1e3bb565 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:40.825102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 55/115] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:40 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:40.828370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ff29b-9394-4247-97ed-95da23bcdcac None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.828738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ff29b-9394-4247-97ed-95da23bcdcac None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.829095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ff29b-9394-4247-97ed-95da23bcdcac None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:40.839815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 56/116] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:40.844371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ff29b-9394-4247-97ed-95da23bcdcac None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:40.911659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:40.936839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2417d0-3fbd-4e9a-9a54-a8da9f48b267 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.980857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ff29b-9394-4247-97ed-95da23bcdcac None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:40.984996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:40.985927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:40.986221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:40.986558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.000359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:41.008976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:41.010038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:41.010788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 61/117] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:41.012173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.027061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a98505-7dad-4c3b-9289-1dce027320e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.027903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a98505-7dad-4c3b-9289-1dce027320e9 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.028061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a98505-7dad-4c3b-9289-1dce027320e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.028385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a98505-7dad-4c3b-9289-1dce027320e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.029283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a98505-7dad-4c3b-9289-1dce027320e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:41.031113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a98505-7dad-4c3b-9289-1dce027320e9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:41.056692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:41.080972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 57/118] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:04:40 2022] POST /identity/v3/projects => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:41.080972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.080972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.080972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.101851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:41.103243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:41.205297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 58/119] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:41.207271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.263447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:41.270963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8c410-e7c4-4649-806f-2f13c36f8ea2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:41.326182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc8aa1-bf7e-44d0-9e17-448ffaa8a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.328283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8aa1-bf7e-44d0-9e17-448ffaa8a574 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.328578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8aa1-bf7e-44d0-9e17-448ffaa8a574 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.328858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8aa1-bf7e-44d0-9e17-448ffaa8a574 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.332384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc8aa1-bf7e-44d0-9e17-448ffaa8a574 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:41.333568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc8aa1-bf7e-44d0-9e17-448ffaa8a574 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:41.335593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 62/120] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:41.336687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd45e-2c8b-45fd-8a79-8d8362c0f264 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.336980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd45e-2c8b-45fd-8a79-8d8362c0f264 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.337718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbd45e-2c8b-45fd-8a79-8d8362c0f264 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.339106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 63/121] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:41.344052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbd45e-2c8b-45fd-8a79-8d8362c0f264 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.387137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d53665-7f78-475e-9717-40e5d704ea3b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:41.441191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.442153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.443136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.443487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.444444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:41.444898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:41.447661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:41.458899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 59/122] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:41.460100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.487402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbd45e-2c8b-45fd-8a79-8d8362c0f264 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:41.489310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:41.527116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bab6d-ca45-4fac-b278-2897536c67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.527878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bab6d-ca45-4fac-b278-2897536c67e3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.528160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bab6d-ca45-4fac-b278-2897536c67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.528438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bab6d-ca45-4fac-b278-2897536c67e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.540743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bab6d-ca45-4fac-b278-2897536c67e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3e1bab6d-ca45-4fac-b278-2897536c67e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:41.550297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:41.551258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:41.552023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 64/123] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:41.557145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.557145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.557145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.576285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:41.576974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:41.580982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:41.588073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162614d-86df-44aa-bd7a-f3e53507f4ae None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:41.625851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.627081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.627597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.628077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/2e90285b16a54207a853a3db25dd94f9/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.633755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=59756a7f62e24aa090a0fc1a4171fde5, user_id=2e90285b16a54207a853a3db25dd94f9, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:41.635264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:41.651451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 60/124] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:41 2022] PUT /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/2e90285b16a54207a853a3db25dd94f9/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:41.652703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.681592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 65/125] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:41.683054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.807151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ab11-a656-4c24-87c3-bbea69520c4a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:41.855708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.857797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.858299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.858787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.861453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:41.863326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:41.866851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 61/126] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:41.868287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:41.879498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:41.892234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3235-e58a-4ced-8eac-8eb5e7bd0338 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:41.898148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:41.962508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:41.963294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:41.963578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:41.963855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:41.965471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:41.965790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:41.967362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:41.978098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 66/127] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:41.978836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.030649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae452-8430-45a5-8ccc-c03d5cc0a2af None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.083860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.085293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.085803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.086272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.108279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:42.115259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020ad1-2ca7-468a-b12d-86546b20e6fc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:42.116804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:42.119181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 62/128] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:42.121404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.165082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.166435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.166847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.167294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.169442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.171714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.175305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 67/129] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:41 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:42.177047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.208798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:42.237066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:42.262093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37346733-2836-4837-9ef1-31e8a7bfa1d6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.300863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b0f7a-2bb4-472c-b391-16752e60091f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.301723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.302629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.302916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.303200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.305285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.306131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.307866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 63/130] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:42 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:42.313358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.342699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.344560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.345351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.345943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.347503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:42.348249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.351146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.362150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 68/131] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:42.363331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.468028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:42.477525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513524-f705-49da-8cbc-c9ed2411113a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.489639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272385-3c1a-4fc9-80f4-4ba48e36bc9a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.515390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.516309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.516596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.516876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/a8b8b54dcb4240b68176774c2828e299/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.519300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=59756a7f62e24aa090a0fc1a4171fde5, user_id=a8b8b54dcb4240b68176774c2828e299, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.520902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.536788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.538438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.538955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.539632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.541500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.543435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.543593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 64/132] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:42 2022] PUT /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/a8b8b54dcb4240b68176774c2828e299/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:42.545983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 69/133] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:42 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:42.550114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.552253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.582875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:42.734074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9acae5-53e9-4d0a-8749-b72f90f82cef None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.740439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7da92-b1db-41ce-9672-a36dd3d19f15 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.774965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.776294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.777017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.777688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/2e90285b16a54207a853a3db25dd94f9/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.780493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] RBAC: Authorizing `identity:create_grant(project_id=59756a7f62e24aa090a0fc1a4171fde5, user_id=2e90285b16a54207a853a3db25dd94f9, role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.782372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.782834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.783289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.783584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.783865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:42.785125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:42.786640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:42.788577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 65/134] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:42 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:42.795412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:42.810245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 70/135] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:42 2022] PUT /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/2e90285b16a54207a853a3db25dd94f9/roles/e339a6a40d554e1189338f7ed25eab3e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:42.913959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:42.945745 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5bda8-20ab-40b2-bb35-28e7748eb998 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:42.997200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041be9c-f481-4bc6-a880-17f6c2228ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:42.998076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041be9c-f481-4bc6-a880-17f6c2228ace None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:42.998365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041be9c-f481-4bc6-a880-17f6c2228ace None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:42.999180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041be9c-f481-4bc6-a880-17f6c2228ace None admin] PATH_INFO: `/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:43.002278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041be9c-f481-4bc6-a880-17f6c2228ace None admin] RBAC: Authorizing `identity:get_project(project_id=227f6f72ea72484e9e96ccd96fb09ca6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:43.004433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041be9c-f481-4bc6-a880-17f6c2228ace None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:43.006596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 66/136] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:42 2022] GET /identity/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6 => generated 313 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:43.012820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:43.042685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:43.160673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361745-5fc7-40c5-bb41-272e6f0a2865 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:43.206733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e3cbb-a1d3-4c30-8c0d-deb17953e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:43.207828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e3cbb-a1d3-4c30-8c0d-deb17953e29a None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:43.208213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e3cbb-a1d3-4c30-8c0d-deb17953e29a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:43.208591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e3cbb-a1d3-4c30-8c0d-deb17953e29a None admin] PATH_INFO: `/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6/users/2e90285b16a54207a853a3db25dd94f9/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:43.210839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e3cbb-a1d3-4c30-8c0d-deb17953e29a None admin] RBAC: Authorizing `identity:create_grant(project_id=227f6f72ea72484e9e96ccd96fb09ca6, user_id=2e90285b16a54207a853a3db25dd94f9, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:43.212571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e3cbb-a1d3-4c30-8c0d-deb17953e29a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:43.229778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 71/137] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:43 2022] PUT /identity/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6/users/2e90285b16a54207a853a3db25dd94f9/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:43.495495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea649-bf92-4f0b-bddf-e0e28e9fe7cb None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:43.496340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea649-bf92-4f0b-bddf-e0e28e9fe7cb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:43.496641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea649-bf92-4f0b-bddf-e0e28e9fe7cb None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:43.498456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 67/138] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:43.504637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:43.505627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:43.506114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:43.530898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:43.532461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:43.635466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 72/139] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:43.674428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea649-bf92-4f0b-bddf-e0e28e9fe7cb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:43.837795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea649-bf92-4f0b-bddf-e0e28e9fe7cb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:43.889219 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:43.890141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:43.890567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:43.890987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:43.905364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:43.913310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:43.914228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:43.914996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 68/140] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:43.920671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:43.923282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:44.056044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8e5c8-3942-4a2d-a8e0-f4e5a1cee47f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:44.110924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:44.112023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.112499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.112965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.113960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:44.114462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:44.116157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66e69-1b39-45d5-b8cd-4bff78450eea None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:44.130408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 73/141] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:43 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:44.136111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:44.143462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:44.273477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e67d4-4710-4126-b980-9a1b8ccbc7dd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:44.311006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52baed9-ab2c-43e4-891a-b84d0306ed9e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.311665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52baed9-ab2c-43e4-891a-b84d0306ed9e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.312136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52baed9-ab2c-43e4-891a-b84d0306ed9e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.316293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 74/142] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:44 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:44.318025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:44.318812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.321158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.321158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] PATH_INFO: `/v3/users/34f05faf10444648855c71613372075a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.321158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] RBAC: Authorizing `identity:get_user(user_id=34f05faf10444648855c71613372075a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:44.322155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:44.324028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 69/143] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:44 2022] GET /identity/v3/users/34f05faf10444648855c71613372075a => generated 290 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:44.329071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.329747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:44.330365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.331210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.371648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:44.373429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:44.413394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:44.451416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3916e9-d5be-469a-ae24-4587d9e1cbec None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:44.479904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:44.494187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 75/144] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:44.502814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:44.503725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.504016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.504301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.509929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:44.511459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:44.513510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 70/145] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:44 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:44.518475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:44.519580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:44.645659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643185-4f30-4c09-9726-1756fb6fe657 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:44.687640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:44.688466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.688753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.689033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/34f05faf10444648855c71613372075a/roles/dcf2d5aa453148329e20ffb9f2121223` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.691230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] RBAC: Authorizing `identity:create_grant(project_id=59756a7f62e24aa090a0fc1a4171fde5, user_id=34f05faf10444648855c71613372075a, role_id=dcf2d5aa453148329e20ffb9f2121223)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:44.692727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:44.717958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:44.723810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 71/146] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:44 2022] PUT /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/users/34f05faf10444648855c71613372075a/roles/dcf2d5aa453148329e20ffb9f2121223 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:04:44.760102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921057bc-4285-4ecb-a030-c272c21cc076 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:44.815771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8351ec-6dd6-41dc-955c-c9f3888d983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:44.816610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8351ec-6dd6-41dc-955c-c9f3888d983d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:44.816896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8351ec-6dd6-41dc-955c-c9f3888d983d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:44.817202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8351ec-6dd6-41dc-955c-c9f3888d983d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:44.818434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8351ec-6dd6-41dc-955c-c9f3888d983d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:44.819933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8351ec-6dd6-41dc-955c-c9f3888d983d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:44.821797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 76/147] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:44.827772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:44.971934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888ea2-9ca7-4039-a1ba-aa9d34862d56 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:45.018656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d22998-0dc1-488a-a7e0-bb5220fd42b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:45.019375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22998-0dc1-488a-a7e0-bb5220fd42b9 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.019732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22998-0dc1-488a-a7e0-bb5220fd42b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.020015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22998-0dc1-488a-a7e0-bb5220fd42b9 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.020808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d22998-0dc1-488a-a7e0-bb5220fd42b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:45.022346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d22998-0dc1-488a-a7e0-bb5220fd42b9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:45.055593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 72/148] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:04:44 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:45.287136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb5049-7239-4491-acbe-45168b3a8b64 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.287470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb5049-7239-4491-acbe-45168b3a8b64 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.287634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb5049-7239-4491-acbe-45168b3a8b64 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.289165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 77/149] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:45.295041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66addb3-41ac-4f1b-8e31-c763f90b41f7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.295329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66addb3-41ac-4f1b-8e31-c763f90b41f7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.295615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66addb3-41ac-4f1b-8e31-c763f90b41f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.324372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d66addb3-41ac-4f1b-8e31-c763f90b41f7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:45.325618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d66addb3-41ac-4f1b-8e31-c763f90b41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:45.389043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:45.414853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 73/150] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:45.452652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb5049-7239-4491-acbe-45168b3a8b64 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:45.532052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:45.586836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb5049-7239-4491-acbe-45168b3a8b64 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:45.658341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:45.659712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.660188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.660655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.683456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:45.685865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fabf8a-bec4-401f-ba15-f49c3f9e32a7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.686299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fabf8a-bec4-401f-ba15-f49c3f9e32a7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.686461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fabf8a-bec4-401f-ba15-f49c3f9e32a7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.688020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 74/151] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:45.694637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:45.695528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:45.696715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 78/152] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:45.697590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.697743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.699256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.708627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:45.734965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:45.734965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:45.852168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e3a3c-7817-4fbe-925d-d4866ea5f4fe None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:45.890780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:45.903602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 75/153] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:45.922413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:45.923275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:45.923664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:45.924044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:45.924929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:45.925370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:45.927027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:45.937972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 79/154] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:45.944772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:45.954581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:46.188982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3b8d8-6c2f-4018-84a3-9ee0e7b1f09c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:46.232248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:46.265955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:46.267064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:46.267420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:46.267760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:46.269157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:46.270751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:46.272541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 76/155] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:45 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:46.279475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:46.297264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be53ee-3cc8-49ac-a84c-efca635b9c34 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:46.376734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:46.380157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:46.380157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:46.380157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:46.408372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:46.421602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:46.422709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:46.423554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 80/156] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:46.429498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:46.502692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:46.528614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d820c-2534-403e-90b7-4d82d707ed9b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:46.572848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec4b38-64b6-42b8-9b1f-168694951214 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:46.580120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:46.580843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:46.581151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:46.581429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:46.619034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:46.620195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:46.620811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:46.621443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:46.622379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:46.622886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:46.624481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:46.634642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 81/157] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:46.652575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:46.665857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:46.689976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:46.691480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:46.789309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57a6c-eeaf-4c97-8a11-9d94e3caea9d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:46.801486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:46.801920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 77/158] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:46.809964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:46.876449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31ebaa-1282-4cfe-9eb8-b4e0793002ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:46.880612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31ebaa-1282-4cfe-9eb8-b4e0793002ca None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:46.881231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31ebaa-1282-4cfe-9eb8-b4e0793002ca None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:46.881770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31ebaa-1282-4cfe-9eb8-b4e0793002ca None admin] PATH_INFO: `/v3/users/a8b8b54dcb4240b68176774c2828e299` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:46.884443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31ebaa-1282-4cfe-9eb8-b4e0793002ca None admin] RBAC: Authorizing `identity:get_user(user_id=a8b8b54dcb4240b68176774c2828e299)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:46.889466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31ebaa-1282-4cfe-9eb8-b4e0793002ca None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:46.891701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 82/159] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:46 2022] GET /identity/v3/users/a8b8b54dcb4240b68176774c2828e299 => generated 248 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:46.893384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85ee31-6fe0-49b8-a560-77a3b1a5e78f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:46.893880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85ee31-6fe0-49b8-a560-77a3b1a5e78f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:46.894374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85ee31-6fe0-49b8-a560-77a3b1a5e78f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:46.896011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 83/160] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:46.905221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85ee31-6fe0-49b8-a560-77a3b1a5e78f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:47.041606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:47.064428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d721a0-e841-480e-9d8b-3691a30e8819 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:47.071097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85ee31-6fe0-49b8-a560-77a3b1a5e78f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:47.112077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d6d50-7b23-4377-bc7a-fc52cccb56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:47.113144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d6d50-7b23-4377-bc7a-fc52cccb56db None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.113451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d6d50-7b23-4377-bc7a-fc52cccb56db None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.113728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d6d50-7b23-4377-bc7a-fc52cccb56db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.136088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e62e-1394-413b-ac21-e7ae0c9ea629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:47.136976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e62e-1394-413b-ac21-e7ae0c9ea629 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.137295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e62e-1394-413b-ac21-e7ae0c9ea629 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.137574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e62e-1394-413b-ac21-e7ae0c9ea629 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.141888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382e62e-1394-413b-ac21-e7ae0c9ea629 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:47.143443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382e62e-1394-413b-ac21-e7ae0c9ea629 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:47.145579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 78/161] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:46 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:47.146820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.147115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.147391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.175378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:47.182088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:47.183543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:47.215366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d6d50-7b23-4377-bc7a-fc52cccb56db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:47.217851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d6d50-7b23-4377-bc7a-fc52cccb56db None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:47.307417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 79/162] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:47.308582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:47.347208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 84/163] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:47.348587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d289-8ce2-452e-937f-9d2434e2caf6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.348969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d289-8ce2-452e-937f-9d2434e2caf6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.349272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7d289-8ce2-452e-937f-9d2434e2caf6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.351349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 85/164] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:47.352041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7d289-8ce2-452e-937f-9d2434e2caf6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:47.436635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:47.453496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:47.466974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7d289-8ce2-452e-937f-9d2434e2caf6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:47.471904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302053ea-efcb-4150-8057-f607a753b9d7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:47.510082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:47.510980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.511784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.512262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.527931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:47.538838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:47.539966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:47.540736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 86/165] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:47.541679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:47.565779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:47.566857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.567387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.567860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.568931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=2e90285b16a54207a853a3db25dd94f9) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:47.569500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:47.571207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65b9c9-43b2-43cb-aedd-5214a2d6e82e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:47.586542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 80/166] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:47 2022] GET /identity/v3/role_assignments?user.id=2e90285b16a54207a853a3db25dd94f9&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 610 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:47.588233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.588759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.589290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.630503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:47.632132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:47.735487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ec8df-00ca-4079-89c1-1b6a2573c932 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:47.832191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:47.833413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:47.834002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:47.834459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:47.839218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:47.841092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:47.843191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 87/167] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:47 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:47.844281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 81/168] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:47.844779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:47.853191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:47.854705 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:48.054734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbae5d4-813f-4b1a-af69-804848ac89a7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:48.083815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:48.103839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:48.104913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.105466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.105902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.107127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:48.107694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:48.109599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:48.126581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 88/169] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:04:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:48.128103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:48.140726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb403-fdf6-41b1-9270-1163fc27ccb4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:48.205973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:48.206659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.206943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.207217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.208076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=a8b8b54dcb4240b68176774c2828e299) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:48.208387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:48.225640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:48.234185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 82/170] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:47 2022] GET /identity/v3/role_assignments?user.id=a8b8b54dcb4240b68176774c2828e299&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:48.235498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:48.308519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:48.363349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f526be-6171-4a4f-a2e6-04af9989a67b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:48.430371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:48.431513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.431793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.432065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.446455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:48.459033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:48.459979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:48.460761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:48.461468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 89/171] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:48.473009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:48.486515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3dd87-1eef-4e98-8992-cd54e6f911bf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:48.577761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:48.579117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.579497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.579777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.583802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:48.585390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:48.587121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 83/172] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:48 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:48.592879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:48.607121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:48.675647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113c82-26b6-45f6-9049-dfb848a4e149 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:48.711045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:48.734951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:48.736487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.737476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.737476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.741164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:48.741164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:48.741164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f990edb-ec15-4669-be5e-705c0c80f928 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:48.749049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff208c-5db1-4882-a39d-2ea83a03c51c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:48.760038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 90/173] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:48 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:48.764161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b56ff-cca1-4560-a509-637ecacfcfe2 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.764559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b56ff-cca1-4560-a509-637ecacfcfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.764789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b56ff-cca1-4560-a509-637ecacfcfe2 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.766817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 91/174] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:48 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:48.773384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.773863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.774146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.800213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:48.800988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:48.801240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:48.801479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:48.801745 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:48.802584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:48.883923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:48.885443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:48.894866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:48.895923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 92/175] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:48.897012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.003263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 84/176] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:49.004017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.031399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a0af-a758-42b4-b414-80dddb4bb057 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:49.051474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:49.074309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:49.075221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:49.075499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:49.075766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] PATH_INFO: `/v3/users/2e90285b16a54207a853a3db25dd94f9` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:49.077036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=2e90285b16a54207a853a3db25dd94f9)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:49.078538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:49.080213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 93/177] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:48 2022] GET /identity/v3/users/2e90285b16a54207a853a3db25dd94f9 => generated 276 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:49.081179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.120394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd2af5-e0f4-4568-a03f-fa9383afb041 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:49.128596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:49.161377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:49.162193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:49.162469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:49.162748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:49.182446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:49.196838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:49.200656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 85/178] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:49.203770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.266222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e5a4-6df0-4e39-a94c-0ce558d3f9a4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:49.341458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:49.342222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:49.342489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:49.342760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:49.345034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:49.346552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:49.348321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 94/179] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:49.349105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.399034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1e5b-8250-4fa3-a572-f15eb787749c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:49.441258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:49.442212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:49.442618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:49.443117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:49.499122 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:49.524523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:49.603428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:49.604985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:49.612824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73939d1-1bac-4c04-a0b5-9a02e27455b1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:49.658837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:49.659563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:49.659845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:49.660116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:49.660869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:49.661237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:49.662755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:49.673076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 95/180] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:49.673980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.804867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 86/181] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:49.805696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.849884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77cc5-4b3f-48f1-8f4a-201b4115fe1c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:49.873947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:49.923615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:49.924503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:49.924970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:49.925676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:49.926546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] RBAC: Adding query filter params (role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=2e90285b16a54207a853a3db25dd94f9) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:49.926858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:49.928373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:49.932817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:49.950856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 96/182] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/role_assignments?user.id=2e90285b16a54207a853a3db25dd94f9&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 610 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:49.952568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:49.989911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04d5b-4982-42e8-a976-5d3a2fccd361 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:50.042035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47f088-d9a6-4a57-8a0b-0f401aadde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:50.042963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47f088-d9a6-4a57-8a0b-0f401aadde89 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.043239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47f088-d9a6-4a57-8a0b-0f401aadde89 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.043510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47f088-d9a6-4a57-8a0b-0f401aadde89 None admin] PATH_INFO: `/v3/users/34f05faf10444648855c71613372075a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.044852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47f088-d9a6-4a57-8a0b-0f401aadde89 None admin] RBAC: Authorizing `identity:get_user(user_id=34f05faf10444648855c71613372075a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:50.046377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47f088-d9a6-4a57-8a0b-0f401aadde89 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:50.048956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 87/183] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/users/34f05faf10444648855c71613372075a => generated 290 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:50.050510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d116b-ae1c-4c84-a6db-74c8e870c5d5 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.050794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d116b-ae1c-4c84-a6db-74c8e870c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.051067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d116b-ae1c-4c84-a6db-74c8e870c5d5 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.052648 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 88/184] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:50.053831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe885af-c514-43e2-902b-03b79c0d22f7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.054117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe885af-c514-43e2-902b-03b79c0d22f7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.054713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe885af-c514-43e2-902b-03b79c0d22f7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.056871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 89/185] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:50.057725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe885af-c514-43e2-902b-03b79c0d22f7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:50.164778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274998d2-69e4-4b4a-a5f6-b149b68d3160 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:50.209877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe885af-c514-43e2-902b-03b79c0d22f7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:50.217906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8258e17-0f34-43b8-818f-448d2792c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:50.218799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8258e17-0f34-43b8-818f-448d2792c867 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.219075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8258e17-0f34-43b8-818f-448d2792c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.219348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8258e17-0f34-43b8-818f-448d2792c867 None admin] PATH_INFO: `/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.220585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8258e17-0f34-43b8-818f-448d2792c867 None admin] RBAC: Authorizing `identity:get_project(project_id=227f6f72ea72484e9e96ccd96fb09ca6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:50.222135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8258e17-0f34-43b8-818f-448d2792c867 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:50.224221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 97/186] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:49 2022] GET /identity/v3/projects/227f6f72ea72484e9e96ccd96fb09ca6 => generated 313 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:50.225469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0ba7-b045-4318-8845-069f192bd056 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.225875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0ba7-b045-4318-8845-069f192bd056 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.226221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0ba7-b045-4318-8845-069f192bd056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.246180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8bba0ba7-b045-4318-8845-069f192bd056 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:50.247660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8bba0ba7-b045-4318-8845-069f192bd056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:50.271890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:50.272611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.273086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.273625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.277594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.309919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.342912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 98/187] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:50.345631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6c72-d49f-458c-befc-5c9748d6aadd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.345923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6c72-d49f-458c-befc-5c9748d6aadd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.346199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6c72-d49f-458c-befc-5c9748d6aadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.353113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:50.354666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:50.371977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-21cc6c72-d49f-458c-befc-5c9748d6aadd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:50.374598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-21cc6c72-d49f-458c-befc-5c9748d6aadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:50.463498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 99/188] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:50.465657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357af1-9554-4b2e-8858-b1767993f79f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.466058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357af1-9554-4b2e-8858-b1767993f79f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.466336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357af1-9554-4b2e-8858-b1767993f79f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.469300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 100/189] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:50.469300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357af1-9554-4b2e-8858-b1767993f79f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:50.486953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 90/190] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:50.487706 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:50.543960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.663279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357af1-9554-4b2e-8858-b1767993f79f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:50.663511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c511d-15bd-447e-b4cc-4e4c04a9a920 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:50.675158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.709834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:50.710648 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.710933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.711320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.715133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:50.715811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.716097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.716377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.717396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=227f6f72ea72484e9e96ccd96fb09ca6, user.id=2e90285b16a54207a853a3db25dd94f9) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:50.717714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:50.719208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5966b-a209-472c-aae1-6a2dadcaeb83 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:50.723126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:50.725820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 101/191] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:50 2022] GET /identity/v3/role_assignments?user.id=2e90285b16a54207a853a3db25dd94f9&scope.project.id=227f6f72ea72484e9e96ccd96fb09ca6&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 610 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:50.727392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.727714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.728004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:50.732819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:50.734150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:50.734968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 91/192] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:50.735617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:50.752976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:50.754706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:50.871308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 102/193] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:50.877628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:50.881153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7ff8f-c74a-4e0a-b3cc-2eb71a44ba7c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:50.887832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:50.955387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:50.956087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:50.956397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:50.956668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:50.957981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:50.960001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:50.964150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 92/194] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:50.964150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.018145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.021625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65feb13-6afe-47e3-9bff-0421ba8ab490 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.058491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.059373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.059659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.060036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.061766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.063536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.065288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 103/195] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:50 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:51.066221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.080803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd468c75-b011-4314-bf8d-734914f4fc03 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.116642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.117360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.117639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.117917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.118678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:51.118985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.120481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.129014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 93/196] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:51.129839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.155057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.178978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab21f98-2a8e-4ebf-aed8-498ca0550f2a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.214132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.214726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.214999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.215265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.225978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:51.234624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:51.235594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:51.236401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 104/197] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:51.237541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.251292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b0a6c-82a6-429b-a987-22f448c4dd8f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.275465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.290959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.291734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.292103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.292423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.293614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.295072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.318831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 94/198] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:04:51 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:51.319732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.380745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8754b5-daaf-4bff-bebf-10fd3e920629 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.434804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.435007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.435991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.436274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.436610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.437549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] RBAC: Adding query filter params (role.id=dcf2d5aa453148329e20ffb9f2121223, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5, user.id=34f05faf10444648855c71613372075a) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:51.437862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.439338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.446740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 105/199] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/role_assignments?user.id=34f05faf10444648855c71613372075a&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=dcf2d5aa453148329e20ffb9f2121223 => generated 610 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:51.450163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.472557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61898d0d-f0da-412b-b747-8e0ffc0e8034 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.517634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.518552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.518922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.519093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] PATH_INFO: `/v3/users/33f1f69be4f94270b838b841a817bd9e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.544316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] RBAC: Authorizing `identity:get_user(user_id=33f1f69be4f94270b838b841a817bd9e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.545811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.547909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 95/200] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/users/33f1f69be4f94270b838b841a817bd9e => generated 284 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:51.554125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.580706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.601980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4314ac-4e51-4eb1-8fcd-1146f981dc72 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.651500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.652199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.652481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.652766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.655303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:51.655303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.656254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.667395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 106/201] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:51.673179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.705985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8d3b3-9a99-4ebf-aaf3-34e41615ceb9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.754501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.755405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.755819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.756231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.770356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:51.825304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a8a0-f738-47c6-a4c4-2156eea248d7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:51.864414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.866190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.870906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:51.872052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:51.873048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:51.873512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] PATH_INFO: `/v3/users/33f1f69be4f94270b838b841a817bd9e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:51.875137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] RBAC: Authorizing `identity:get_user(user_id=33f1f69be4f94270b838b841a817bd9e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:51.876836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:51.884391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 107/202] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/users/33f1f69be4f94270b838b841a817bd9e => generated 284 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:51.885922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:51.925046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:52.007628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 96/203] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:52.014298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:52.030958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd1e1-b777-43f5-a536-72ab786aeb45 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:52.071102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:52.079768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:52.080688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:52.081082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:52.081475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:52.158259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a581-1991-47c5-84d0-0047f913416c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:52.181759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:52.183319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:52.201265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:52.202312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:52.202699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:52.203077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:52.204502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:52.206160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:52.208111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 97/204] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:52 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:52.216063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:52.226795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:52.337566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 108/205] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:04:52.343384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:52.350490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf026f-5e86-4ef6-99e5-7c5a5b5d8cfd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:52.359241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:52.389874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:52.390831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:52.391244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:52.394463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:52.394463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=33f1f69be4f94270b838b841a817bd9e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:52.394463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:52.397558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:52.404068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 98/206] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:52 2022] GET /identity/v3/role_assignments?user.id=33f1f69be4f94270b838b841a817bd9e&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:52.462954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9c26e-6d0a-4e86-ab35-dd918e7646d6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:52.491472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:52.504893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1cf63-6822-4985-97a0-03cbb73351df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:52.505871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1cf63-6822-4985-97a0-03cbb73351df None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:52.506166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1cf63-6822-4985-97a0-03cbb73351df None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:52.506451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1cf63-6822-4985-97a0-03cbb73351df None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:52.507732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1cf63-6822-4985-97a0-03cbb73351df None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:52.509338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1cf63-6822-4985-97a0-03cbb73351df None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:52.511645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 109/207] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:52 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:52.517941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:52.638145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88843f9-e54c-4871-a384-998fd6eae3dd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:52.677775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:52.678454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:52.678744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:52.679031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:52.679896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] RBAC: Adding query filter params (role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=33f1f69be4f94270b838b841a817bd9e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:52.680213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:52.681734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435d936-102b-4249-a4b3-170e44da19e8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:52.688691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 99/208] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:52 2022] GET /identity/v3/role_assignments?user.id=33f1f69be4f94270b838b841a817bd9e&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:53.752431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acd59b-05c9-4b01-984d-66081bae5f62 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:53.756310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acd59b-05c9-4b01-984d-66081bae5f62 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:53.759329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acd59b-05c9-4b01-984d-66081bae5f62 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:53.760948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 110/209] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:53 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:53.768579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:53.769780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:53.770256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:53.793091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:53.794888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:53.807443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4142-67d3-4865-8be3-6530b87ad828 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:53.807889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4142-67d3-4865-8be3-6530b87ad828 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:53.808437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4142-67d3-4865-8be3-6530b87ad828 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:53.809873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 111/210] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:04:53.815366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:53.815665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:53.815926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:53.835447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:53.835816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:53.837203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:53.890234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 100/211] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:53.915440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:53.940768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 112/212] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:53.974856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.059989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaa159-6bca-4bf7-bae5-eae95a565d74 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:54.118491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:54.119973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.120671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.121195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.121453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8370f94-3e27-4ab7-b525-0839eda4ec4f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:54.136909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:54.147131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:54.148259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:54.149335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:54.157644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 101/213] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:04:54.157873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.158787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.165611 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:54.166722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.167320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.168018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.169518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:54.171182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:54.177945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 113/214] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:53 2022] GET /identity/v3/domains/default => generated 200 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:54.179446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.189022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.268610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8c3f0-d33e-4dee-bbdb-84de747ea72b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:54.289701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744127-0224-4a67-bf15-cc64408d0471 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:54.305777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:54.306567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.306945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.307335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.308185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:54.308556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:54.310289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:54.319874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 102/215] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:54 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:54.325617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.333093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:54.334100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.334556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.335002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.335925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:54.337818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:54.365786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 114/216] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:04:54 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:04:54.447668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.466644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3aea4e-fe9a-4e73-baf7-794aba5d41c9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:54.507402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63659-84e0-4318-abd1-f0093c574c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:54.508903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63659-84e0-4318-abd1-f0093c574c70 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.509435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63659-84e0-4318-abd1-f0093c574c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.509908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63659-84e0-4318-abd1-f0093c574c70 None admin] PATH_INFO: `/v3/users/ceb83fd34bf443e89e9eb763297c20a1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.527025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf63659-84e0-4318-abd1-f0093c574c70 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb83fd34bf443e89e9eb763297c20a1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:54.528935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf63659-84e0-4318-abd1-f0093c574c70 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:54.531364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 103/217] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:54 2022] GET /identity/v3/users/ceb83fd34bf443e89e9eb763297c20a1 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:54.537923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.590972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.656793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259e6c-3c3c-4572-af33-ad93e7020e0b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:54.690737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae5c7-d237-4371-b196-e8f6b66e704f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.691399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae5c7-d237-4371-b196-e8f6b66e704f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.691896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae5c7-d237-4371-b196-e8f6b66e704f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.695550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 104/218] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:54.699765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91504a-0e22-4230-b63a-136487824973 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.700720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91504a-0e22-4230-b63a-136487824973 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.700720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91504a-0e22-4230-b63a-136487824973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.703679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:54.704410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:54.704699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:54.704983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:54.727550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a91504a-0e22-4230-b63a-136487824973 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:54.728696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a91504a-0e22-4230-b63a-136487824973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:54.797532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:54.799047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:54.837524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 105/219] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:54.864926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91504a-0e22-4230-b63a-136487824973 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.875584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.955191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 115/220] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:54.960146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:54.961681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:54.987452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91504a-0e22-4230-b63a-136487824973 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.030600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb814b89-9646-4603-b6d3-f8a718800965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.032026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814b89-9646-4603-b6d3-f8a718800965 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.032512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814b89-9646-4603-b6d3-f8a718800965 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.032795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814b89-9646-4603-b6d3-f8a718800965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.049393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb814b89-9646-4603-b6d3-f8a718800965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fb814b89-9646-4603-b6d3-f8a718800965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:55.059832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:55.060812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:55.061642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:55.062667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 106/221] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:04:55.065303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135a8f-c7f0-47c2-a149-ce83aa1b55fb None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.065799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135a8f-c7f0-47c2-a149-ce83aa1b55fb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.066299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135a8f-c7f0-47c2-a149-ce83aa1b55fb None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.069242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 107/222] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:55 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:55.070981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135a8f-c7f0-47c2-a149-ce83aa1b55fb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.149560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d808400-d1f3-4021-ae37-bd3a4cc7a3a2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.196150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757423fe-9c49-4fc2-aeee-94732a65b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.197214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757423fe-9c49-4fc2-aeee-94732a65b31b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.197500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757423fe-9c49-4fc2-aeee-94732a65b31b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.197807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757423fe-9c49-4fc2-aeee-94732a65b31b None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.199182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757423fe-9c49-4fc2-aeee-94732a65b31b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:55.200667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757423fe-9c49-4fc2-aeee-94732a65b31b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:55.202887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 116/223] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:54 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:55.203882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.204166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.204441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.220307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135a8f-c7f0-47c2-a149-ce83aa1b55fb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.226462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:55.227694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:55.238485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:55.266936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.267625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.267908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.268189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.268965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:55.269302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:55.270884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:55.273340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:55.282572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 108/224] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:55.284420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.314356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 117/225] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:55.315238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.421636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715e4dd-e1c3-4739-ab27-d8a7d2a97945 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.464578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.465621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.466039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.466447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.467764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=ceb83fd34bf443e89e9eb763297c20a1) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:55.468229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:55.469059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137dc71-e338-4109-90ea-1e4db01db5b1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.470731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:55.480230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 109/226] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:55 2022] GET /identity/v3/role_assignments?user.id=ceb83fd34bf443e89e9eb763297c20a1&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:55.481337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.519794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.519794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.519794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.519794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] PATH_INFO: `/v3/users/33f1f69be4f94270b838b841a817bd9e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.520529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=33f1f69be4f94270b838b841a817bd9e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:55.522354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:55.525235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 118/227] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:55 2022] GET /identity/v3/users/33f1f69be4f94270b838b841a817bd9e => generated 284 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:55.538595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.578508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:55.579565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:55.685277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1013e-bc69-48f9-8fe3-b3fbe323a1a1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.736782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58030fb2-3a49-4ef1-adb9-6cfee59de5f4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:55.755447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.756643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.757172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.757644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.782331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:55.792131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:55.793060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:04:55.793906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:55.797197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 110/228] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:04:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:55.803077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.819277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:55.820168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:55.820451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:55.820727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:55.822960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:55.824507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:55.826512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 119/229] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:55 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:55.832259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:55.954912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:55.987040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b351-b003-4ef4-8066-c8b3101f8e54 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:56.002118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c27ad-4604-4513-943a-c9f2d1591fc5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:56.030426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:56.046852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:56.047692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:56.048078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:56.048453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:56.049414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:56.049819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:56.051494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:56.062301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 111/230] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:04:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:56.069413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:56.088068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:56.089687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:56.090023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:56.090309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/33f1f69be4f94270b838b841a817bd9e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:56.092919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d9ac4afb4cea8b9976807764c170, user_id=33f1f69be4f94270b838b841a817bd9e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:56.094452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:56.123165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 120/231] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:55 2022] PUT /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/33f1f69be4f94270b838b841a817bd9e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:56.221862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcb8a8-723b-4afe-882c-d1e5cbec0af9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:56.268767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:56.269708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:56.269987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:56.270261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] PATH_INFO: `/v3/users/33f1f69be4f94270b838b841a817bd9e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:56.271492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=33f1f69be4f94270b838b841a817bd9e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:56.272945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:56.275707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 112/232] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:56 2022] GET /identity/v3/users/33f1f69be4f94270b838b841a817bd9e => generated 284 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:56.280500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:56.442736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f315c2-d33d-4cf7-a37b-62d39c2d5292 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:56.484242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee67b-f3f4-4d5b-bafd-f1c46f4fc714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:56.485051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee67b-f3f4-4d5b-bafd-f1c46f4fc714 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:56.485359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee67b-f3f4-4d5b-bafd-f1c46f4fc714 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:56.485657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee67b-f3f4-4d5b-bafd-f1c46f4fc714 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:56.488245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ee67b-f3f4-4d5b-bafd-f1c46f4fc714 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:56.489752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ee67b-f3f4-4d5b-bafd-f1c46f4fc714 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:56.491844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 121/233] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:56 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:56.497815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:56.572819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:56.641046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabbbe9-b0ca-49a9-8d2c-6c8ef7ac7ac8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:56.690794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc3402-d1c0-4a0f-80e0-f0dd13379d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:56.692100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3402-d1c0-4a0f-80e0-f0dd13379d0e None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:56.692590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3402-d1c0-4a0f-80e0-f0dd13379d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:56.693065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3402-d1c0-4a0f-80e0-f0dd13379d0e None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/33f1f69be4f94270b838b841a817bd9e/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:56.699097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3402-d1c0-4a0f-80e0-f0dd13379d0e None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d9ac4afb4cea8b9976807764c170, user_id=33f1f69be4f94270b838b841a817bd9e, role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:56.701077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3402-d1c0-4a0f-80e0-f0dd13379d0e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:56.718555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 113/234] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:56 2022] PUT /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/33f1f69be4f94270b838b841a817bd9e/roles/e339a6a40d554e1189338f7ed25eab3e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:04:57.041837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27565459-2cdc-466f-942e-9e72c6e388ba None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.043154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27565459-2cdc-466f-942e-9e72c6e388ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.043693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27565459-2cdc-466f-942e-9e72c6e388ba None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.046310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 122/235] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:57 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:57.052491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805b27e-0902-4508-96b0-200136318917 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.053501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805b27e-0902-4508-96b0-200136318917 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.053982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805b27e-0902-4508-96b0-200136318917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.076353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f805b27e-0902-4508-96b0-200136318917 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:57.078014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f805b27e-0902-4508-96b0-200136318917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:57.175861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 114/236] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:57.216400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27565459-2cdc-466f-942e-9e72c6e388ba None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:57.226213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:57.347259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882dd4d-bfef-4eed-8624-d5baa9eb2382 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.347644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882dd4d-bfef-4eed-8624-d5baa9eb2382 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.347829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882dd4d-bfef-4eed-8624-d5baa9eb2382 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.349255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 115/237] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:04:57.354265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.355239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.355526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.376236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27565459-2cdc-466f-942e-9e72c6e388ba None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:57.377146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:57.381147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:57.421835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:57.449741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:57.451845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.452129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.452409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.476281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:57.490999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:57.491952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:57.492744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 123/238] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:57.500671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:57.508236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 116/239] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:04:57.530862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:57.618059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:57.681952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1b60-1037-47c6-89bf-3d628b8b9a2a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:57.753034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:57.753768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.754321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.754787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.755719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:57.756096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:57.757707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:57.773267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f8374-9771-46d7-9177-67f68bbb15bb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:57.779080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 124/240] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:57 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:57.784913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:57.827872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:57.828694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.828979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.829283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.831327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:57.832833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:57.835339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 117/241] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:04:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:57.846194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:57.931910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065bace-9fe8-44ed-9f62-08786d61573e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:57.951464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:57.967287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:57.976689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca718ccc-023b-4d63-a0c2-33ca9935a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:57.977627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca718ccc-023b-4d63-a0c2-33ca9935a641 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:57.977904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca718ccc-023b-4d63-a0c2-33ca9935a641 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:57.978172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca718ccc-023b-4d63-a0c2-33ca9935a641 None admin] PATH_INFO: `/v3/users/927d51ed8e93474b9f7d3e985d3925f1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:57.997040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca718ccc-023b-4d63-a0c2-33ca9935a641 None admin] RBAC: Authorizing `identity:get_user(user_id=927d51ed8e93474b9f7d3e985d3925f1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:57.998819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca718ccc-023b-4d63-a0c2-33ca9935a641 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:58.000891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 125/242] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:57 2022] GET /identity/v3/users/927d51ed8e93474b9f7d3e985d3925f1 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:58.002222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3c9c-b8d0-4887-bb70-1d6cb73a6a1f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.002500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3c9c-b8d0-4887-bb70-1d6cb73a6a1f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.002773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3c9c-b8d0-4887-bb70-1d6cb73a6a1f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.012460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 126/243] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:58 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:58.012460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3c9c-b8d0-4887-bb70-1d6cb73a6a1f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:58.035797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de00e4-3310-486e-be85-5da772a71c5c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:58.078183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0cb3-da65-43da-a9e8-4a5b61a203a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:58.079730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0cb3-da65-43da-a9e8-4a5b61a203a4 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.080198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0cb3-da65-43da-a9e8-4a5b61a203a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.080700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0cb3-da65-43da-a9e8-4a5b61a203a4 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.081818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef0cb3-da65-43da-a9e8-4a5b61a203a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:58.083605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef0cb3-da65-43da-a9e8-4a5b61a203a4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:58.109323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 118/244] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:04:57 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:04:58.111338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.111807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.112339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.130690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3c9c-b8d0-4887-bb70-1d6cb73a6a1f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:58.137900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:58.139435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:58.172654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:58.173604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.173882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.174140 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.231284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 119/245] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:58.241635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:58.261895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:58.263425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:58.290424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:58.340598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:58.412513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 127/246] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:04:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:04:58.414290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:58.515995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b18c-5ba0-4a3a-ba1b-019450b0cd7c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:58.546431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:58.572336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:58.573309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.573653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.573891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.574641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31759bad-dc11-472d-8a8b-efa2d13634fa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:58.589408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:58.599139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:58.600214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:04:58.601462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 120/247] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:04:58.612428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:58.644809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:58.645788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.646080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.646359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.647583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:58.649072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:58.655832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 128/248] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:58 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:58.657071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:58.788142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:58.836962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bd054-e536-4fbd-a68f-6dcc0796d659 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:58.840155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0057ea-2efa-48f1-8760-addb78fcc5e4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:58.895311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:58.896571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.897041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.897554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.899294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] RBAC: Adding query filter params (role.id=dcf2d5aa453148329e20ffb9f2121223, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=927d51ed8e93474b9f7d3e985d3925f1) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:58.899861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:58.902764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7859b-8f22-4aa8-abad-e35b517e5710 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:58.910293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:58.911360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.911822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.912277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.913389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:58.913738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:58.913895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 129/249] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:04:58 2022] GET /identity/v3/role_assignments?user.id=927d51ed8e93474b9f7d3e985d3925f1&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=dcf2d5aa453148329e20ffb9f2121223 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:58.915125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:58.915781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5aba4-3e41-404d-a528-b197afe32ffd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.916075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5aba4-3e41-404d-a528-b197afe32ffd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.916391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5aba4-3e41-404d-a528-b197afe32ffd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.917906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 130/250] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:58.927297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:58.927648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:58.927862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:58.942481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 121/251] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:04:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:58.948792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:58.958885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:58.960170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:58.976404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:59.141150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 131/252] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:04:59.158899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b88a1a-b317-4e2f-93f0-9f4313f725bc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:59.187753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:59.220079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:59.221046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.221370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.221651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] PATH_INFO: `/v3/users/ceb83fd34bf443e89e9eb763297c20a1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.223974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb83fd34bf443e89e9eb763297c20a1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:59.225578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:59.227371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 122/253] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:58 2022] GET /identity/v3/users/ceb83fd34bf443e89e9eb763297c20a1 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:59.242641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:59.262498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:59.360721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec6ea-9e4a-494e-8f3e-ba1dc76dc059 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:59.410200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:59.411018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.411400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.411639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.412884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:59.414504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:59.421315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 123/254] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:04:59 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:04:59.422424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4efa6-3b95-4f49-85a5-09225d7c8a3a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:59.422746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:59.487594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:59.488537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.488789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.489069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.511929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:59.513465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:04:59.530249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c755-f5ca-4aa0-a41f-34b7af3eab26 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:04:59.531432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:04:59.532330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:04:59.533143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 132/255] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:04:59.542340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:59.566575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:59.567492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.567779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.568059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/ceb83fd34bf443e89e9eb763297c20a1/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.570114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d9ac4afb4cea8b9976807764c170, user_id=ceb83fd34bf443e89e9eb763297c20a1, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:59.571730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:59.575591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:04:59.588918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 124/256] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:04:59 2022] PUT /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/ceb83fd34bf443e89e9eb763297c20a1/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:04:59.771565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9030d-06df-4cc6-a393-1dd21aed749d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:04:59.830383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:04:59.831424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.831851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.832270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.833525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:04:59.834002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:04:59.836257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff897f-06fa-445c-9e37-69f9774c6e70 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:04:59.850365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 133/257] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:04:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:04:59.856356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:04:59.913486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693057-5aa4-4b91-9efb-184a09e61708 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.913812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693057-5aa4-4b91-9efb-184a09e61708 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.914047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693057-5aa4-4b91-9efb-184a09e61708 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.915955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 134/258] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:04:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:04:59.925673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:04:59.925972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:04:59.926287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:04:59.974210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:04:59.977458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:04:59.990939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6e5ad-38ab-43b9-bcc4-3e6d7702bacf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:00.030462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:00.031945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:00.032647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:00.033183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] PATH_INFO: `/v3/users/33f1f69be4f94270b838b841a817bd9e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:00.034923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] RBAC: Authorizing `identity:get_user(user_id=33f1f69be4f94270b838b841a817bd9e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:00.036678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:00.039326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 125/259] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:04:59 2022] GET /identity/v3/users/33f1f69be4f94270b838b841a817bd9e => generated 284 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:00.045449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:00.069497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:00.141299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:00.161841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 135/260] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:04:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:00.200940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e26e15-f7ad-48e9-b208-38587d959f59 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:00.217922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:00.242142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:00.242820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:00.243108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:00.243388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:00.319065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:00.320162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:00.348730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:00.448660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 126/261] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:00.454803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:00.474399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a499cf-a2c1-4264-b46f-652c02454514 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:00.558683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052774f1-7a92-499a-83aa-490795456979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:00.559540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052774f1-7a92-499a-83aa-490795456979 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:00.559825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052774f1-7a92-499a-83aa-490795456979 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:00.560104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052774f1-7a92-499a-83aa-490795456979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:00.583081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052774f1-7a92-499a-83aa-490795456979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-052774f1-7a92-499a-83aa-490795456979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:00.599872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:00.600845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:00.601665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 136/262] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:00.610029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052774f1-7a92-499a-83aa-490795456979 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:00.633921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db870a-84c4-42b5-8d3d-d5219f83dea7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:00.661494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:00.712300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:00.715459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:00.716789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:00.717073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:00.717371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:00.721888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:00.723502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:00.725586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 127/263] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:00 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:00.731859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:00.760828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052774f1-7a92-499a-83aa-490795456979 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:00.796562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:00.797293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:00.797580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:00.797859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:00.798623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:00.798930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:00.800365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:00.812508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 137/264] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:00 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:00.815507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:00.942376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716ae8a-a5e9-4eeb-a01f-56920ac8c239 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:01.007222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:01.007945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:01.008232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:01.008509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:01.009383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=33f1f69be4f94270b838b841a817bd9e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:01.009699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:01.011614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:01.024101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 128/265] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:00 2022] GET /identity/v3/role_assignments?user.id=33f1f69be4f94270b838b841a817bd9e&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:01.053653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a129c-d8c8-438e-9cff-1edb66c8db10 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:01.080496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:01.095336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:01.096251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:01.096533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:01.096808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] PATH_INFO: `/v3/users/33f1f69be4f94270b838b841a817bd9e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:01.098076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] RBAC: Authorizing `identity:get_user(user_id=33f1f69be4f94270b838b841a817bd9e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:01.099550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:01.101594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 138/266] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:00 2022] GET /identity/v3/users/33f1f69be4f94270b838b841a817bd9e => generated 284 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:01.107430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:01.181316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:01.258530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f5d1-dab1-48ea-8930-3d8324c9a453 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:01.298357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:01.299072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:01.299360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:01.299639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:01.380836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:01.382546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:01.443040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:01.520806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 129/267] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:01.527101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:01.699458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765361c-afb2-4ba9-848a-e4f71c8f07a5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:01.749994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ef3c8-f3bc-465c-a4e4-9a388015beec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:01.751129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ef3c8-f3bc-465c-a4e4-9a388015beec None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:01.753500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ef3c8-f3bc-465c-a4e4-9a388015beec None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:01.753942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ef3c8-f3bc-465c-a4e4-9a388015beec None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:01.757856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ef3c8-f3bc-465c-a4e4-9a388015beec None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:01.759542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ef3c8-f3bc-465c-a4e4-9a388015beec None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:01.761526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 139/268] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:01 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:01.770366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:01.823957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df241f-dff6-4e3c-a730-f477e1e7472f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:01.824610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df241f-dff6-4e3c-a730-f477e1e7472f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:01.825083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df241f-dff6-4e3c-a730-f477e1e7472f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:01.826737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 140/269] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:01.846038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:01.846670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:01.847138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:01.878398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:01.879939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:01.955960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:01.966155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40535-70c0-41e0-9d74-c4449ec5588b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.000585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 141/270] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:02.005937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.006618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.006904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.007186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.008042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] RBAC: Adding query filter params (role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=33f1f69be4f94270b838b841a817bd9e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:02.008358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:02.009864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3e76-e9cf-4b7d-8655-2a3dc5d8e0bd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:02.017140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 130/271] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:01 2022] GET /identity/v3/role_assignments?user.id=33f1f69be4f94270b838b841a817bd9e&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 610 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:02.044827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.102522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f9b2-f777-4f5e-a6d4-152afaabbe81 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.102902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f9b2-f777-4f5e-a6d4-152afaabbe81 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.103278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f9b2-f777-4f5e-a6d4-152afaabbe81 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.106786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 131/272] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:02 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:02.113729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.114253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.114640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.145652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:02.157172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:02.158463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:02.255520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c007b-ae71-44e2-adc2-8beff646a159 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.269369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 132/273] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:02.296842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.299275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06082f-49a8-4c0e-b196-77c9f611863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.300419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06082f-49a8-4c0e-b196-77c9f611863d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.300836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06082f-49a8-4c0e-b196-77c9f611863d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.301261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06082f-49a8-4c0e-b196-77c9f611863d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.313821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06082f-49a8-4c0e-b196-77c9f611863d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fd06082f-49a8-4c0e-b196-77c9f611863d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:02.322185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:02.323235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:02.324509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 142/274] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:02.329860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260cf33-14a9-4bb1-ba53-9261b3d53527 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.330525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260cf33-14a9-4bb1-ba53-9261b3d53527 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.331197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260cf33-14a9-4bb1-ba53-9261b3d53527 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.333627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 143/275] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:02 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:02.337234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260cf33-14a9-4bb1-ba53-9261b3d53527 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.409431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:02.432014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895cad1-7706-4e2c-9072-a6954add78bd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.467807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260cf33-14a9-4bb1-ba53-9261b3d53527 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.485869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dbf4d-36ae-4a9f-96c8-fe241c9c201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.487615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dbf4d-36ae-4a9f-96c8-fe241c9c201f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.488076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dbf4d-36ae-4a9f-96c8-fe241c9c201f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.488522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dbf4d-36ae-4a9f-96c8-fe241c9c201f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.490618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dbf4d-36ae-4a9f-96c8-fe241c9c201f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:02.492590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dbf4d-36ae-4a9f-96c8-fe241c9c201f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:02.495712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 133/276] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/domains/default => generated 200 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:02.498781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.499481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.499968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.506512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.507202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.507487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.507770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.508540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:02.508845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:02.510457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:02.514180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:02.520513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 144/277] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:02.521388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.535253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:02.537323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:02.623370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 134/278] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:02.624361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.654797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58989c85-56c0-485b-9abf-bbe123a9794a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.668968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:02.694805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.695494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.695777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.696058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.696778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:02.698471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:02.722375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 145/279] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:02 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:02.723222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.775243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d6db-a76e-40ff-9b34-554291d507cd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.833655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124f07d-86e6-44a6-82c6-069970ea34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.834718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124f07d-86e6-44a6-82c6-069970ea34e8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.835085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124f07d-86e6-44a6-82c6-069970ea34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.835437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124f07d-86e6-44a6-82c6-069970ea34e8 None admin] PATH_INFO: `/v3/users/fcf8acd35f744929ab7e031a2078af18` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.838193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:02.856840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124f07d-86e6-44a6-82c6-069970ea34e8 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf8acd35f744929ab7e031a2078af18)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:02.858463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124f07d-86e6-44a6-82c6-069970ea34e8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:02.869639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 135/280] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/users/fcf8acd35f744929ab7e031a2078af18 => generated 294 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:02.869639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3b55-ee0c-4ea0-a71e-de47239db941 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.869639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3b55-ee0c-4ea0-a71e-de47239db941 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.869639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3b55-ee0c-4ea0-a71e-de47239db941 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.869639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 136/281] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:02 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:02.872727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.873146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.873513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.891332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7ef1e-6bab-4a47-adcf-0d1252949f50 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:02.897172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:02.898543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:02.948911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:02.949739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:02.950007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:02.950281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:02.969507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:02.988135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 137/282] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:02.989499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:02.990421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:02.991209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:02.992326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:02.992408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 146/283] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:02.998894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.037743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:03.125967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a5d1-20bc-4824-839b-89149ef4877f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.134930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd6128-d0e9-40fe-af94-21fcda9f8323 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.161499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:03.176115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.177051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.177499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.177933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.178692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:03.178995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.180524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:03.182454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.184500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.185228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.185900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.188689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, user.id=fcf8acd35f744929ab7e031a2078af18, scope.system=all) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:03.189479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.190491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 147/284] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:03.191344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.192809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:03.206376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 138/285] 10.222.0.113 () {56 vars in 1313 bytes} [Mon Jul 25 19:05:02 2022] GET /identity/v3/role_assignments?user.id=fcf8acd35f744929ab7e031a2078af18&scope.system=all&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 227 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:03.208736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.306037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:03.339050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319367-4bbd-4f2d-8896-548fe1042b8a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.382819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd29eeb-676a-4190-818c-c626b293aa08 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.408544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.410104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.410529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.410971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.424846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.425935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.426321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.426696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] PATH_INFO: `/v3/users/927d51ed8e93474b9f7d3e985d3925f1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.426881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:03.428177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] RBAC: Authorizing `identity:get_user(user_id=927d51ed8e93474b9f7d3e985d3925f1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.429868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:03.432175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 139/286] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/users/927d51ed8e93474b9f7d3e985d3925f1 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:03.435686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:03.436631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:03.437486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:03.439825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 148/287] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:03.444808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.446248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.542903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:03.558929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb75bb-319e-44a1-a2aa-165e848d916f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.597183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b469e-930b-41d0-a53a-1d04f314917b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.637019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.638197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.638624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.639070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.640448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.642398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:03.644892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 140/288] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:03.650355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.655886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.661644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.662088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.662505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.663439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:03.663977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.665566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:03.682272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 149/289] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:03.688626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.705455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:03.800498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7519-28f7-433f-9301-e6e245ea7012 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.837518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.838744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.839174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.839600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] PATH_INFO: `/v3/users/ceb83fd34bf443e89e9eb763297c20a1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.841164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb83fd34bf443e89e9eb763297c20a1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.842894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:03.845149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 150/290] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/users/ceb83fd34bf443e89e9eb763297c20a1 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:03.850250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:03.935088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111914-9cf8-468a-a335-750d079703ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:03.969156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:03.986510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:03.987830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.989378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.990021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/927d51ed8e93474b9f7d3e985d3925f1/roles/dcf2d5aa453148329e20ffb9f2121223` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.994401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d9ac4afb4cea8b9976807764c170, user_id=927d51ed8e93474b9f7d3e985d3925f1, role_id=dcf2d5aa453148329e20ffb9f2121223)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:03.996346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:04.006937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:04.040220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f72d26-c822-4749-8768-70d3dd9b33a1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:04.056169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 141/291] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:03 2022] PUT /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/users/927d51ed8e93474b9f7d3e985d3925f1/roles/dcf2d5aa453148329e20ffb9f2121223 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:04.112012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:04.114286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:04.115466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:04.116273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:04.242600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:04.244498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:04.346754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:04.383239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 151/292] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:04.395004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:04.526354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f035-f7e3-4d00-8daf-ec62262c093f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:04.564330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999d9b-101b-4f25-a2f8-5577f6969f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:04.565281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999d9b-101b-4f25-a2f8-5577f6969f50 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:04.565566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999d9b-101b-4f25-a2f8-5577f6969f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:04.565899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999d9b-101b-4f25-a2f8-5577f6969f50 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:04.567243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd999d9b-101b-4f25-a2f8-5577f6969f50 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:04.568734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd999d9b-101b-4f25-a2f8-5577f6969f50 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:04.570591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 142/293] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:04 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:04.577543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:04.717545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e529fb-5cfc-454a-b439-ed5b87d7d5ef None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:04.758517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:04.759190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:04.759475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:04.759747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:04.761049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=ceb83fd34bf443e89e9eb763297c20a1) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:04.761362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:04.762835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4da1-64c5-4fcb-bf50-19b64806a990 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:04.769709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 152/294] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:04 2022] GET /identity/v3/role_assignments?user.id=ceb83fd34bf443e89e9eb763297c20a1&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:05.407084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2c85-0674-4975-a34a-7193e00d64a0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.408016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2c85-0674-4975-a34a-7193e00d64a0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.408433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2c85-0674-4975-a34a-7193e00d64a0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.410037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 143/295] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:05.415950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.416467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.416875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.441840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:05.443485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:05.504357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:05.556159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 153/296] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:05.576739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d89002-4826-42bc-ac17-202e8fc21ab5 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.577033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d89002-4826-42bc-ac17-202e8fc21ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.577374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d89002-4826-42bc-ac17-202e8fc21ab5 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.579771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 144/297] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:05.580974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:05.586151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.586448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.586739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.608157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:05.609983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:05.686192 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:05.709231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ce10f-42be-4b1b-99f2-1228af37cf46 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:05.722118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 145/298] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:05.749376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:05.761174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf32467-dc18-46a5-a448-d914824ffe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:05.762045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32467-dc18-46a5-a448-d914824ffe01 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.762330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32467-dc18-46a5-a448-d914824ffe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.762648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32467-dc18-46a5-a448-d914824ffe01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.763895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf32467-dc18-46a5-a448-d914824ffe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:05.765381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf32467-dc18-46a5-a448-d914824ffe01 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:05.767260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 154/299] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:05.768326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcc394-52a8-43dc-98b4-41154f019324 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.768606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcc394-52a8-43dc-98b4-41154f019324 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.768871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcc394-52a8-43dc-98b4-41154f019324 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.770251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 155/300] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:05 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:05.774230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcc394-52a8-43dc-98b4-41154f019324 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:05.827765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:05.878732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee305-84e5-4f2e-868d-dc10cc480c0d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:05.901690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcc394-52a8-43dc-98b4-41154f019324 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:05.926167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a6125-c6d2-444d-8eac-edc91f37d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:05.927086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a6125-c6d2-444d-8eac-edc91f37d58e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.927451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a6125-c6d2-444d-8eac-edc91f37d58e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.927768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a6125-c6d2-444d-8eac-edc91f37d58e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.941091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a6125-c6d2-444d-8eac-edc91f37d58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a20a6125-c6d2-444d-8eac-edc91f37d58e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:05.949802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:05.950738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:05.951534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 146/301] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:05.952701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.953027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.953324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.959339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:05.960260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:05.960540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:05.960845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] PATH_INFO: `/v3/groups` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:05.961623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:05.963244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:05.977108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:05.978423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:05.997160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 156/302] 10.222.0.113 () {60 vars in 1139 bytes} [Mon Jul 25 19:05:05 2022] POST /identity/v3/groups => generated 230 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:05.997160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.036869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:06.096521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 147/303] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:06.119087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.167986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:06.173680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60a43-7162-418f-b86b-8854a5d82514 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.226058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.226663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.226993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.227380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.228188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:06.228503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:06.230199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:06.243875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 157/304] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:05 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:06.253517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.273184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658da47-ce4a-4331-9cec-008823118d43 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.321142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.322887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.323347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.323770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.338658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:06.349938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:06.351079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:06.352147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:06.355503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 148/305] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:06.364792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.408138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd982ba-0591-40f8-8300-0bef228329c3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.415938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:06.457822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.458964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.459387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.459829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] PATH_INFO: `/v3/users/81e4d54cb2b24df48ef634391ec09389` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.484134 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] RBAC: Authorizing `identity:get_user(user_id=81e4d54cb2b24df48ef634391ec09389)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:06.485905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:06.492589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 158/306] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:06 2022] GET /identity/v3/users/81e4d54cb2b24df48ef634391ec09389 => generated 294 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:06.493954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.505348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d84e8-2e6d-4f3a-9116-75332b202eb8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.522803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:06.550724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.551236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.551520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.551800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.552586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:06.553144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:06.555215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:06.572113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 149/307] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:06 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:06.573686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.632514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a27c4-30d3-4b7e-bda8-26fc05dbb438 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.677439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.678508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.678972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.679563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.680743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] RBAC: Adding query filter params (role.id=dcf2d5aa453148329e20ffb9f2121223, user.id=81e4d54cb2b24df48ef634391ec09389, scope.system=all) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:06.681250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:06.682938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:06.689100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 159/308] 10.222.0.113 () {56 vars in 1313 bytes} [Mon Jul 25 19:05:06 2022] GET /identity/v3/role_assignments?user.id=81e4d54cb2b24df48ef634391ec09389&scope.system=all&role.id=dcf2d5aa453148329e20ffb9f2121223 => generated 227 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:06.698180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:06.703114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4fc46-e0ee-4ac9-90da-8aa988f95b94 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.754392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fee936-3193-4e1c-ad3d-8808ba1f6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.755196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee936-3193-4e1c-ad3d-8808ba1f6f7b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.755481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee936-3193-4e1c-ad3d-8808ba1f6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.755760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee936-3193-4e1c-ad3d-8808ba1f6f7b None admin] PATH_INFO: `/v3/users/fcf8acd35f744929ab7e031a2078af18` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.757091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fee936-3193-4e1c-ad3d-8808ba1f6f7b None admin] RBAC: Authorizing `identity:get_user(user_id=fcf8acd35f744929ab7e031a2078af18)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:06.758628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fee936-3193-4e1c-ad3d-8808ba1f6f7b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:06.761854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 150/309] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:06 2022] GET /identity/v3/users/fcf8acd35f744929ab7e031a2078af18 => generated 294 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:06.770954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:06.884497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:06.911231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f3ec8-f98b-46e5-99b2-591d84b47753 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:06.957029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1dd9-29b2-4cf0-8c73-f5162bb7d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:06.958319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1dd9-29b2-4cf0-8c73-f5162bb7d76e None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:06.958793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1dd9-29b2-4cf0-8c73-f5162bb7d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:06.959275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1dd9-29b2-4cf0-8c73-f5162bb7d76e None admin] PATH_INFO: `/v3/system/users/fcf8acd35f744929ab7e031a2078af18/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:06.961223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1dd9-29b2-4cf0-8c73-f5162bb7d76e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcf8acd35f744929ab7e031a2078af18, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:06.962899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1dd9-29b2-4cf0-8c73-f5162bb7d76e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:06.979481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 160/310] 10.222.0.113 () {58 vars in 1339 bytes} [Mon Jul 25 19:05:06 2022] PUT /identity/v3/system/users/fcf8acd35f744929ab7e031a2078af18/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:07.009528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce84f2-63cf-4c89-b0b1-4c4c15471deb None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:07.009528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce84f2-63cf-4c89-b0b1-4c4c15471deb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:07.009528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce84f2-63cf-4c89-b0b1-4c4c15471deb None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:07.010041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 151/311] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:07.016214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:07.016552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:07.016805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:07.037840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:07.039489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:07.132091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 161/312] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:07.155349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce84f2-63cf-4c89-b0b1-4c4c15471deb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:07.280694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce84f2-63cf-4c89-b0b1-4c4c15471deb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:07.322031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:07.323053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:07.323386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:07.323658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:07.338430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:07.347234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:07.348178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:07.348995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:07.353248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 152/313] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:07.356970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:07.471054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:07.500328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2385ca2-10a5-4ae8-a20e-6366a8c1d6ba None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:07.542232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:07.543386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:07.543867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:07.544409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:07.545574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:07.546159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:07.547930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:07.560595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 162/314] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:07 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:07.569268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:07.609265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:07.702978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed84676-7e28-4b43-ba72-5118a4bb6d57 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:07.746969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:07.748314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:07.748798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:07.749332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] PATH_INFO: `/v3/users/927d51ed8e93474b9f7d3e985d3925f1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:07.750766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] RBAC: Authorizing `identity:get_user(user_id=927d51ed8e93474b9f7d3e985d3925f1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:07.752841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:07.761080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 153/315] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:07 2022] GET /identity/v3/users/927d51ed8e93474b9f7d3e985d3925f1 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:07.762824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:07.913316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c2596-15bc-4c39-b2f7-d22e9250bf23 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:07.960575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743f0f9-8b86-4e78-9665-2373006ff7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:07.961278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f0f9-8b86-4e78-9665-2373006ff7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:07.961558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f0f9-8b86-4e78-9665-2373006ff7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:07.961830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f0f9-8b86-4e78-9665-2373006ff7c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:07.998086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:08.071165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f0f9-8b86-4e78-9665-2373006ff7c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:08.073547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f0f9-8b86-4e78-9665-2373006ff7c5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:08.233794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 163/316] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:08.239659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:08.364173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:08.368333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b429-f97b-4967-8b43-c2d7d0fc5f27 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:08.368655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b429-f97b-4967-8b43-c2d7d0fc5f27 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:08.368878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b429-f97b-4967-8b43-c2d7d0fc5f27 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:08.371209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 164/317] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:08.377466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:08.377794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:08.378027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:08.386022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020c0a-6b6d-4d40-abe2-fc43dd5abc0a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:08.403524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:08.405206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:08.440695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:08.441931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:08.442215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:08.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:08.443947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:08.445715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:08.449189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 154/318] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:08 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:08.452623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:08.457189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:08.508384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 165/319] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:08.532301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:08.600803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca903-1234-4713-8082-8d0130279cef None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:08.659354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:08.660403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:08.660932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:08.661388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:08.662389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] RBAC: Adding query filter params (role.id=dcf2d5aa453148329e20ffb9f2121223, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170, user.id=927d51ed8e93474b9f7d3e985d3925f1) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:08.662827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:08.664428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:08.681389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 155/320] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:08 2022] GET /identity/v3/role_assignments?user.id=927d51ed8e93474b9f7d3e985d3925f1&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=dcf2d5aa453148329e20ffb9f2121223 => generated 610 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:08.687902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa88f-2ce1-44cf-be4a-3c6c66cec7c8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:08.751775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd0f05-0660-435d-b839-9d04bf8afbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:08.752799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd0f05-0660-435d-b839-9d04bf8afbaa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:08.753167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd0f05-0660-435d-b839-9d04bf8afbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:08.753455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd0f05-0660-435d-b839-9d04bf8afbaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:08.755104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd0f05-0660-435d-b839-9d04bf8afbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:08.759796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd0f05-0660-435d-b839-9d04bf8afbaa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:08.769905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 166/321] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:08.772187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:08.821772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:08.933649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c6149-192a-4304-818d-cacb0e35f1f5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:08.981102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f03a7-4857-418e-a6ca-d8705a81fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:08.982222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f03a7-4857-418e-a6ca-d8705a81fbb7 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:08.982481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f03a7-4857-418e-a6ca-d8705a81fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:08.982734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f03a7-4857-418e-a6ca-d8705a81fbb7 None admin] PATH_INFO: `/v3/groups` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:08.983435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f03a7-4857-418e-a6ca-d8705a81fbb7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:08.985045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f03a7-4857-418e-a6ca-d8705a81fbb7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:09.012118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 156/322] 10.222.0.113 () {60 vars in 1139 bytes} [Mon Jul 25 19:05:08 2022] POST /identity/v3/groups => generated 227 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:05:09.178257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c2b0-1e0d-44e5-b2ad-248e9384a8a9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.178832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c2b0-1e0d-44e5-b2ad-248e9384a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.179239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c2b0-1e0d-44e5-b2ad-248e9384a8a9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.181681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 167/323] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:09.188224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e791-a10e-4564-b288-04f57fb330a3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.188550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e791-a10e-4564-b288-04f57fb330a3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.188791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e791-a10e-4564-b288-04f57fb330a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.212184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a1e8e791-a10e-4564-b288-04f57fb330a3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:09.214182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a1e8e791-a10e-4564-b288-04f57fb330a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:09.324841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 157/324] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:09.355975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c2b0-1e0d-44e5-b2ad-248e9384a8a9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.385539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aefc3-a797-4802-8d6b-96666f08336a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.386019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aefc3-a797-4802-8d6b-96666f08336a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.386299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aefc3-a797-4802-8d6b-96666f08336a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.388064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 158/325] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:09.399150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.399525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.399817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.425370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:09.428553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:09.429346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:09.435810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:09.548458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c2b0-1e0d-44e5-b2ad-248e9384a8a9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:09.559587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 159/326] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:09.586679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.604050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:09.604882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.605271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.605625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.632002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:09.641988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:09.643189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:09.644190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:09.646452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 168/327] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:09.658498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.757046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54078c4-45e1-4ec1-8336-985ef1683992 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:09.830658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:09.834258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c5e-98e5-4f22-b1a6-4c6ccc151218 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:09.836600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:09.837948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.837948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.838142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.851223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:09.857230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:09.867967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:09.868990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:09.869871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:09.874055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 160/328] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:09.881296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:09.893553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:09.894531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:09.894873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:09.895149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:09.895923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:09.896413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:09.897940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:09.910261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 169/329] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:09 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:09.915307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.043549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050cbab-c829-4a02-911e-aec2b8637c9c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.090530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a34d8e-0bad-4fc3-89d8-cb58b9f994f1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.114283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.115087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.115373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.115654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.116440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:10.116750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.119352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.131983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 161/330] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:09 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:10.138207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.154011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.154939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.155220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.155501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] PATH_INFO: `/v3/users/81e4d54cb2b24df48ef634391ec09389` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.156772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] RBAC: Authorizing `identity:get_user(user_id=81e4d54cb2b24df48ef634391ec09389)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.158319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.160344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 170/331] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:09 2022] GET /identity/v3/users/81e4d54cb2b24df48ef634391ec09389 => generated 294 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:10.166453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.215803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:10.275962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:10.414499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30963f07-cabd-4102-a086-830102f2b0fa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.435936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa1a2f-7e6c-4bd1-b354-b053a23625f6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.487385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.488305 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.488592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.488869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] PATH_INFO: `/v3/users/fcf8acd35f744929ab7e031a2078af18` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.490175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] RBAC: Authorizing `identity:get_user(user_id=fcf8acd35f744929ab7e031a2078af18)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.491657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.494398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 162/332] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:10 2022] GET /identity/v3/users/fcf8acd35f744929ab7e031a2078af18 => generated 294 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:10.502709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:10.510029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7b99c-45ed-423e-abdc-bbacd609d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.512354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7b99c-45ed-423e-abdc-bbacd609d044 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.512800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7b99c-45ed-423e-abdc-bbacd609d044 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.513261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7b99c-45ed-423e-abdc-bbacd609d044 None admin] PATH_INFO: `/v3/system/users/81e4d54cb2b24df48ef634391ec09389/roles/dcf2d5aa453148329e20ffb9f2121223` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.520469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7b99c-45ed-423e-abdc-bbacd609d044 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=81e4d54cb2b24df48ef634391ec09389, role_id=dcf2d5aa453148329e20ffb9f2121223)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.522161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7b99c-45ed-423e-abdc-bbacd609d044 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.537034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 171/333] 10.222.0.113 () {58 vars in 1339 bytes} [Mon Jul 25 19:05:10 2022] PUT /identity/v3/system/users/81e4d54cb2b24df48ef634391ec09389/roles/dcf2d5aa453148329e20ffb9f2121223 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:10.688522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd0ea-3aff-4f20-88e1-b02809e9f775 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:10.722004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:10.728758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:10.730497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:10.731624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:10.732066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:10.733100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] RBAC: Adding query filter params (role.id=48a5339c8e664d73b4d1667aa69648a8, user.id=fcf8acd35f744929ab7e031a2078af18, scope.system=all) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:10.733597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:10.735217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83292e2c-4328-49f0-905a-1b8aea453957 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:10.752713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 163/334] 10.222.0.113 () {56 vars in 1313 bytes} [Mon Jul 25 19:05:10 2022] GET /identity/v3/role_assignments?user.id=fcf8acd35f744929ab7e031a2078af18&scope.system=all&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 512 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:12.334245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26465f-74be-41e4-9f5d-e32c486c645b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.335036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26465f-74be-41e4-9f5d-e32c486c645b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.335036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26465f-74be-41e4-9f5d-e32c486c645b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.336430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 172/335] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:12.346552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeafb3d-a608-4139-97ff-3ace1be71f05 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.347516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeafb3d-a608-4139-97ff-3ace1be71f05 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.347995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeafb3d-a608-4139-97ff-3ace1be71f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.372626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9eeafb3d-a608-4139-97ff-3ace1be71f05 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:12.374276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9eeafb3d-a608-4139-97ff-3ace1be71f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:12.470433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 164/336] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:12.506202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26465f-74be-41e4-9f5d-e32c486c645b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:12.531685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2580a3c-cbe4-44c2-9313-cd71cea88720 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.532209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2580a3c-cbe4-44c2-9313-cd71cea88720 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.532663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2580a3c-cbe4-44c2-9313-cd71cea88720 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.534526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 165/337] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:12.540140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b0d08-4b74-4ccc-8854-9a90f4a49b95 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.540775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b0d08-4b74-4ccc-8854-9a90f4a49b95 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.541327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b0d08-4b74-4ccc-8854-9a90f4a49b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.578241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a76b0d08-4b74-4ccc-8854-9a90f4a49b95 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:12.579825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a76b0d08-4b74-4ccc-8854-9a90f4a49b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:12.669045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:12.689457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26465f-74be-41e4-9f5d-e32c486c645b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:12.743562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 166/338] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:12.759901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:12.760921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.761226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.761507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.785152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33654859-eb8b-411e-ac6f-d3cfb141ccd4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.785710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33654859-eb8b-411e-ac6f-d3cfb141ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.785833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:12.786242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33654859-eb8b-411e-ac6f-d3cfb141ccd4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.787788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 167/339] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:12.795182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e216-06a7-437f-936e-260b876718f4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.795697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e216-06a7-437f-936e-260b876718f4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.796135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e216-06a7-437f-936e-260b876718f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:12.797869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:12.798910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:12.799824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 173/340] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:12.801757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:12.840661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c737e216-06a7-437f-936e-260b876718f4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:12.845917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c737e216-06a7-437f-936e-260b876718f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:12.961408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:13.009899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 168/341] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:13.011405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e216-06a7-437f-936e-260b876718f4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.035618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b82ae-cfb6-44eb-b0bc-47bb67d19d7e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.119672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.121480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.124014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.124555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.149257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:13.166562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:13.167504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:13.168395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:13.171811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 174/342] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:13.172966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.215552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:13.227367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e216-06a7-437f-936e-260b876718f4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.284983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.286640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.287121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.287588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.288711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:13.289593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:13.291374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:13.303131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 169/343] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:13.305312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.379061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:13.463656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf510c20-d968-47ce-b309-341aa5ce7083 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.491624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dcb58-d158-4671-b19e-1cd04eeda5d2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.527786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.529473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.530189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.531364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.533005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:13.533835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:13.539517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:13.556656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 170/344] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:13.559258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.579224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.579458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.579684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.579970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.604029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:13.630162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:13.631169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:13.632064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:13.633288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 175/345] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:13.633647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.727423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d436d9-ee04-429a-907d-2affc25fbf97 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.745587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:13.781318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:13.802643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.803313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.803593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.803869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.846517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b3eb-ff00-4ac4-8cfa-4a06a5f69be5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.914371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef304e-c06d-4308-8c1b-14f3d7637e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.915036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef304e-c06d-4308-8c1b-14f3d7637e47 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.915314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef304e-c06d-4308-8c1b-14f3d7637e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.915595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef304e-c06d-4308-8c1b-14f3d7637e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.943760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:13.945420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:14.007219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef304e-c06d-4308-8c1b-14f3d7637e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:14.008825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef304e-c06d-4308-8c1b-14f3d7637e47 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:14.081371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 171/346] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:14.082566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:14.086556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:14.129084 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:14.182536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 176/347] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:14.183944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaed09a-8e46-4097-b124-6ae2e635e0f7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.184235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaed09a-8e46-4097-b124-6ae2e635e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.184511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaed09a-8e46-4097-b124-6ae2e635e0f7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.185889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 177/348] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:14.186580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaed09a-8e46-4097-b124-6ae2e635e0f7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:14.237586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa22c-6547-477e-b110-a176ca65a516 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:14.289780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:14.290828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.291339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.291840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.292576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:14.292882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:14.294870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74e22-7954-4970-8370-1660d5b2496a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:14.306657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 172/349] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:14.308752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e7dfb-39c9-4d2b-91eb-fdc4a1a94f6e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.309036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e7dfb-39c9-4d2b-91eb-fdc4a1a94f6e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.309353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e7dfb-39c9-4d2b-91eb-fdc4a1a94f6e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.310836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 173/350] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:14.314500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff09f3-96ee-4573-a99e-dc812c6fe681 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.315339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff09f3-96ee-4573-a99e-dc812c6fe681 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.315628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff09f3-96ee-4573-a99e-dc812c6fe681 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.317056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 174/351] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:14 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:14.317798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff09f3-96ee-4573-a99e-dc812c6fe681 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:14.332533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaed09a-8e46-4097-b124-6ae2e635e0f7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:14.385957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f29d-74d7-4e3f-9ebe-f110a88ebae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:14.386842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f29d-74d7-4e3f-9ebe-f110a88ebae1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.387124 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f29d-74d7-4e3f-9ebe-f110a88ebae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.387395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f29d-74d7-4e3f-9ebe-f110a88ebae1 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.388626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f29d-74d7-4e3f-9ebe-f110a88ebae1 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:14.390143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f29d-74d7-4e3f-9ebe-f110a88ebae1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:14.392228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 178/352] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:14 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:14.397757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f800-e2a2-4ccc-9b5a-340f7e2a1fca None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.398051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f800-e2a2-4ccc-9b5a-340f7e2a1fca None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.398316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f800-e2a2-4ccc-9b5a-340f7e2a1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.402668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:14.426394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c171f800-e2a2-4ccc-9b5a-340f7e2a1fca None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:14.427599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c171f800-e2a2-4ccc-9b5a-340f7e2a1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:14.457807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff09f3-96ee-4573-a99e-dc812c6fe681 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:14.471949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:14.518090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:14.519482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.519934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.520377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.522296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:14.524663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:14.527947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 175/353] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:14 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:14.529321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:14.532755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 179/354] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:14.534665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386630f9-57fe-4f35-9ae6-9235aca83e61 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.535108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386630f9-57fe-4f35-9ae6-9235aca83e61 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.535583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386630f9-57fe-4f35-9ae6-9235aca83e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.560793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-386630f9-57fe-4f35-9ae6-9235aca83e61 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:14.561882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-386630f9-57fe-4f35-9ae6-9235aca83e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:14.665436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 180/355] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:14.667653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.667653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.667653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.690952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:14.690952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:14.707683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c0583-6389-427b-9c46-e3baad7c6395 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:14.743904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:14.752424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:14.753494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.753955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.754392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.780622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 181/356] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:14.781611 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:14.827059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:14.847958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:14.849468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:14.932153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42fbb7-42ce-4286-b85d-7a07051fe66e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:14.987814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:14.988949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:14.989466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:14.989815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 176/357] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:14.990137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:14.990670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:14.998530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.000023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.001816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 182/358] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:14 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.002695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.033392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:15.127195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd248-a904-4ba4-9351-1dedcf22b7db None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.148032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:15.156885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c21bfc-65d9-4e27-bb7f-e2ce809c9d70 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.186797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.186797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.187093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.187330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.189562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.191094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.193310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 177/359] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:14 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.194398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.208003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.208834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.209133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.209417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.221713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:15.231462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:15.232495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:15.233355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 183/360] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:15.234058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.344238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:15.348787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa8a9d-c05a-4008-b0c7-29d4b8d3e1a7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.371392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20f8a-9cae-4599-ac12-6dbdf7f18489 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.411740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.412649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.412931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.413225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.424737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.426581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.426581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.426581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.431723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:15.439765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:15.440734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:15.441599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 178/361] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:15.442272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.446923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:15.457200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:15.458381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 184/362] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:15.459370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.483836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:15.598874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28393216-3438-4024-a4cd-22534baa6125 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.603271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963554-7c94-496d-aef5-54ed8045a9b8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.635570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.636257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.636539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.636818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.637714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:15.638022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.640165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.646609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.647494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.647783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.648054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.648657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 185/363] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 261 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.652678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.652815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.652890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.657398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 179/364] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.658760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.700289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:15.763944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:15.792336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0514e-a2ac-457a-911c-6273d387ef9e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.799883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42f81-8966-4467-a408-4ae664a5e496 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.844653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.845370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.845652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.845923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.846679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:15.846984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.848252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.848400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.848945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.849260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.849536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.850425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:15.850741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.852226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.859095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 180/366] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.859281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 186/366] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 261 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.860011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.860749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.015381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.034905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793acc-904a-442e-923b-46c5ede93fc0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.038669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9fa1-58db-4446-ad14-f02e46d8b5b2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.092306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.093506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.093958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.094458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.095985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:16.096489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.099046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.108962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.110640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.111537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.112171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.113686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:16.114399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.121208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 187/367] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:16.121208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.121451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.126600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.135519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 181/368] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:16.136846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.249687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b84293-0154-42b5-8c82-9ea511ddb719 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.250191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab403-8361-4a83-812c-ba1230cb053a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.287975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.289571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.289948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.290285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.290859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.291328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.291825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.292319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.293715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.295410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.302528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 188/369] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:16.303438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.317614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.374692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.376831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.398278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.434331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e798f-d2f7-435b-b1b9-26823df7e4f4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.489955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 182/370] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:16.490641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.491697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.492046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.492505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.492938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] PATH_INFO: `/v3/users/81e4d54cb2b24df48ef634391ec09389` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.495374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] RBAC: Authorizing `identity:get_user(user_id=81e4d54cb2b24df48ef634391ec09389)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.497736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.500962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 189/371] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/users/81e4d54cb2b24df48ef634391ec09389 => generated 294 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:16.502530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.558209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.610654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73300d99-725a-4bb4-9937-4fc5f67c52b0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.624325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f19259-26e3-46d7-8e2f-300b4c07d673 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.645226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.645893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.646173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.646440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.647266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:16.647573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.649231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.655374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 190/372] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 261 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:16.656005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.660673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.665196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.666169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.666626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.667041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.767727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.769526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.841582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:16.884974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ba042-851b-473b-8338-08c5d7f38f91 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:16.931781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 183/373] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:16.932619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:16.964250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:16.966159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:16.966821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:16.967467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:16.970990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:16.974851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:16.980162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 191/374] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:16.982533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:17.134535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:17.148416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e342fe-159f-4329-b291-27e09c6abfc9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:17.186149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f09a-1349-4cc4-84fd-6304ecce7679 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:17.223006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:17.223884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:17.224163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:17.224437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] PATH_INFO: `/v3/projects/b55401b6f7164ec1b40688c01754b91f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:17.225642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] RBAC: Authorizing `identity:get_project(project_id=b55401b6f7164ec1b40688c01754b91f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:17.227107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:17.228909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 192/375] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/projects/b55401b6f7164ec1b40688c01754b91f => generated 345 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:17.229709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:17.242384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:17.243061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:17.243341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:17.243611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:17.244730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] RBAC: Adding query filter params (role.id=dcf2d5aa453148329e20ffb9f2121223, user.id=81e4d54cb2b24df48ef634391ec09389, scope.system=all) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:17.245022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:17.246488 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:17.283656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 184/376] 10.222.0.113 () {56 vars in 1313 bytes} [Mon Jul 25 19:05:16 2022] GET /identity/v3/role_assignments?user.id=81e4d54cb2b24df48ef634391ec09389&scope.system=all&role.id=dcf2d5aa453148329e20ffb9f2121223 => generated 512 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:17.284523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:17.317096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:17.390845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88d35-85d7-482e-aaae-4521cfc0466e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:17.459562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:17.460439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:17.460721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:17.460973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:17.465354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:17.466855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:17.468798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 193/377] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:17 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:17.474817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:17.491534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:17.496224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1e917-0a3d-4b9d-b137-9fec48a0a669 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:17.556433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:17.559275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:17.559549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:17.559817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] PATH_INFO: `/v3/groups/a261b1acda9c4c9b8cc7a8c0f676d061` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:17.575528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] RBAC: Authorizing `identity:get_group(group_id=a261b1acda9c4c9b8cc7a8c0f676d061)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:17.577015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:17.578983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 185/378] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:17 2022] GET /identity/v3/groups/a261b1acda9c4c9b8cc7a8c0f676d061 => generated 230 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:17.586943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:17.672363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1c1c9-8f13-4a1a-a40a-5305a8020780 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:17.693518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:17.737489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:17.738759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:17.740818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:17.741340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:17.742392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:17.745028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:17.748599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b01137-cdf3-43b0-80a8-1b58eeeaa639 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:17.749532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7935b-44e6-45f2-9ddd-de7d7abb0264 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:17.766676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 194/379] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:17 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 261 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:17.799575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:17.800722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:17.801382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:17.801889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:17.808016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] RBAC: Adding query filter params (group.id=a261b1acda9c4c9b8cc7a8c0f676d061, role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=b55401b6f7164ec1b40688c01754b91f) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:17.808669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:17.810497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa62b51-eb9f-4eba-962c-952a0f7ab273 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:17.817514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 186/380] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:17 2022] GET /identity/v3/role_assignments?group.id=a261b1acda9c4c9b8cc7a8c0f676d061&scope.project.id=b55401b6f7164ec1b40688c01754b91f&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 261 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:18.181605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b2b1-da4c-4cb0-8807-7731fe08841c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.182250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b2b1-da4c-4cb0-8807-7731fe08841c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.182528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b2b1-da4c-4cb0-8807-7731fe08841c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.184105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 195/381] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:18.189982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.190583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.191049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.214576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:18.216961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:18.252243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465562-3b7d-444a-8438-3cf1304e1714 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.252595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465562-3b7d-444a-8438-3cf1304e1714 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.252800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465562-3b7d-444a-8438-3cf1304e1714 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.254418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 196/382] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:18.260725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.261062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.261490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.286956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:18.289345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:18.324827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 187/383] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:18.352120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.412028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 197/384] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:18.440704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.442857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.470611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.534049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b18a3-eafd-46b9-909d-9b568ea91ef0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:18.605887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:18.607474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.607999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.608270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.622478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5368865-eea9-4b4b-a974-400405cfa8bc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:18.630258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:18.642813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:18.644496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:18.646059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:18.652068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 188/385] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:18.658921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.668307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:18.669465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.669887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.670340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.687872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:18.702144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:18.703262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:18.704243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:18.709261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 198/386] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:18.713730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.821348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.823374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e65a6-b5a5-4e6f-8af6-8a1cdbc53e7e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:18.857896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.868081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:18.869704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.870448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.870873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.872041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:18.872512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:18.874068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:18.883502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 189/387] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:18.890864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.927528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2db2-7b9b-4c9f-838e-928b1dc1387a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.016118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.019413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.020383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.020987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.022887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:19.023453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.027005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.039384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 199/388] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:19.047030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.115364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b3f5-a76a-41c8-a046-8cc95dcd8005 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.218910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729d093-cc22-41bc-9f2b-8e5dc35e0118 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.225891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.226792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.227079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.227361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.229796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.231574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.233656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 190/389] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:19.238892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.250056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.264764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.266023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.266511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.267011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.268403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.270563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.272450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 200/390] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:19.282809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.350793 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.429632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e657f6-9fef-439e-8499-9f6750618245 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.466573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5deed1-88e5-44ee-bb70-eaa760908088 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.470927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a547f-138d-408b-bae1-b3362ab3a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.471842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a547f-138d-408b-bae1-b3362ab3a443 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.472124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a547f-138d-408b-bae1-b3362ab3a443 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.472398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a547f-138d-408b-bae1-b3362ab3a443 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.473807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a547f-138d-408b-bae1-b3362ab3a443 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.475435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a547f-138d-408b-bae1-b3362ab3a443 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.477767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 191/391] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:19.479399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f685-a76b-4374-a39f-7cd0e7d9b634 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.479683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f685-a76b-4374-a39f-7cd0e7d9b634 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.479958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f685-a76b-4374-a39f-7cd0e7d9b634 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.486332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 192/392] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:19.487249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f685-a76b-4374-a39f-7cd0e7d9b634 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.511463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1fc1d-5649-46f5-942c-678834199dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.512356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1fc1d-5649-46f5-942c-678834199dda None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.512634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1fc1d-5649-46f5-942c-678834199dda None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.512905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1fc1d-5649-46f5-942c-678834199dda None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.514238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1fc1d-5649-46f5-942c-678834199dda None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.515752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1fc1d-5649-46f5-942c-678834199dda None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.518031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 201/393] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:19.519320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.519613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.519889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.539217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:19.540458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:19.602259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.607139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f685-a76b-4374-a39f-7cd0e7d9b634 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.614754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 202/394] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:19.615653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.652252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.669392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.670288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.670568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.670939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.673261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] RBAC: Authorizing `identity:create_grant(project_id=59756a7f62e24aa090a0fc1a4171fde5, group_id=5f82abe0dfe144c98839ae6390d9b82c, role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.674918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.692419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 193/395] 10.222.0.113 () {58 vars in 1447 bytes} [Mon Jul 25 19:05:19 2022] PUT /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/e339a6a40d554e1189338f7ed25eab3e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:19.693399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.767506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4af9a-17c5-4f57-a417-7c9527ad58a7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.829037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200092e-7b7c-441b-993c-61cf40d0c805 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.871539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.872474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.872758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.873031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.875023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.876107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.876422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.876703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.879595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=59756a7f62e24aa090a0fc1a4171fde5, group_id=5f82abe0dfe144c98839ae6390d9b82c, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.882405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.890428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:19.900685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:19.901792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:19.902613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:19.905197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 194/396] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:19.910637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.916775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 203/397] 10.222.0.113 () {58 vars in 1447 bytes} [Mon Jul 25 19:05:19 2022] PUT /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:19.978827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:20.064766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a2ec5-762f-4425-b132-104e35aa5c1e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:20.105985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:20.106894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.107175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.107448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.108222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:20.108525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:20.111448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:20.120638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 195/398] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:20.126595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:20.187141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:20.254254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875bc23-08b2-45a0-8374-c129995c96e5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:20.312972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:20.313890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.314169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.314440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.315622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:20.317077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:20.318903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 204/399] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:20 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:20.324604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:20.485718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f70cb-d680-49df-bf62-8ca1c6ba323a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:20.496468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:20.537156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff64b-8265-426c-8206-5f5d95653b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:20.538052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff64b-8265-426c-8206-5f5d95653b08 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.538335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff64b-8265-426c-8206-5f5d95653b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.538614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff64b-8265-426c-8206-5f5d95653b08 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.539836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff64b-8265-426c-8206-5f5d95653b08 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:20.542089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff64b-8265-426c-8206-5f5d95653b08 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:20.543832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 196/400] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:20 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:20.549979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:20.566653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dca38c-c9d9-4917-b3de-7d919dfbbf5a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.566960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dca38c-c9d9-4917-b3de-7d919dfbbf5a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.567217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dca38c-c9d9-4917-b3de-7d919dfbbf5a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.568774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 197/401] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:20.587366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd306-abce-4dfe-993a-f106b8b9dc05 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.588299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd306-abce-4dfe-993a-f106b8b9dc05 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.588583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd306-abce-4dfe-993a-f106b8b9dc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.628195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2bfbd306-abce-4dfe-993a-f106b8b9dc05 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:20.629360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2bfbd306-abce-4dfe-993a-f106b8b9dc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:20.712160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23430ed5-5f5f-4a0e-bf6b-1963228491c0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:20.732291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:20.734130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 198/402] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:20.735556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe136ad3-3a21-4b5f-afb9-c5daabfa3f9a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.735851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe136ad3-3a21-4b5f-afb9-c5daabfa3f9a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.736311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe136ad3-3a21-4b5f-afb9-c5daabfa3f9a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.738315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 199/403] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:20.746681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.747252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.747631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.769448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:20.770348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:20.770632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:20.770903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:20.771186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:20.772576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:20.772921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d9ac4afb4cea8b9976807764c170, group_id=5f82abe0dfe144c98839ae6390d9b82c, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:20.774422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:20.789781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 205/404] 10.222.0.113 () {58 vars in 1447 bytes} [Mon Jul 25 19:05:20 2022] PUT /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:20.794109 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:20.877887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 200/405] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:20.922351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:20.969385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96d90-4ae1-49d8-8136-081a37d10b72 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:20.980571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.012974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049543-c30b-4450-945a-746fffd20957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.014118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049543-c30b-4450-945a-746fffd20957 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.014562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049543-c30b-4450-945a-746fffd20957 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.014983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049543-c30b-4450-945a-746fffd20957 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.027741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049543-c30b-4450-945a-746fffd20957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-09049543-c30b-4450-945a-746fffd20957 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:21.036497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:21.037601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:21.038403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:21.045497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 206/406] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:21.049584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049543-c30b-4450-945a-746fffd20957 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:21.085548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b29d-6125-4500-9b4d-6ffe0afe66bd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.124826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.125151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.125926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.126206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.126477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.138364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:21.146363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:21.147320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:21.152969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 201/407] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:21.156807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:21.185096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049543-c30b-4450-945a-746fffd20957 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.262058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.263273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.264620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.265850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.266845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:21.267547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:21.270361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:21.291601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 207/408] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:21.298131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:21.387647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.415126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d6131-1644-4d11-8937-2d997004e936 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.421133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.426498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e88984-172f-4cdc-b0a4-24b1a7061426 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.466694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.467938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.468512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.468982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.470676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:21.472540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:21.479471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 208/409] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:21 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:21.481737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:21.523721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.524409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.524733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.525067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.526158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:21.526504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:21.527904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:21.551387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 202/410] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:21.566199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:21.601422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780c88-55e4-4e21-81c8-13d9baa968aa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.639440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.640802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.641309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.641810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.643344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:21.645150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:21.647630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 209/411] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:21 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:21.653957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:21.701411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:21.767543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da091f31-7d34-4be7-bf7b-e17e9b7760fe None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.809283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.811162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.811724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.812197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.815267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0d9ac4afb4cea8b9976807764c170, group_id=5f82abe0dfe144c98839ae6390d9b82c, role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:21.816964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:21.841230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 210/412] 10.222.0.113 () {58 vars in 1447 bytes} [Mon Jul 25 19:05:21 2022] PUT /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170/groups/5f82abe0dfe144c98839ae6390d9b82c/roles/e339a6a40d554e1189338f7ed25eab3e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:21.909749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5a8f-1581-4d17-9fa1-f176cd721aee None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:21.970400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:21.971278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:21.971563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:21.971836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] PATH_INFO: `/v3/groups/a261b1acda9c4c9b8cc7a8c0f676d061` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:21.978302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] RBAC: Authorizing `identity:get_group(group_id=a261b1acda9c4c9b8cc7a8c0f676d061)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:21.979799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:21.981885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 203/413] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:21 2022] GET /identity/v3/groups/a261b1acda9c4c9b8cc7a8c0f676d061 => generated 230 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:21.989384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.112103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.128651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033056-bf51-4d6c-b863-3882c3f57eac None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:22.167317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cd1ad-c30e-4025-a58e-eab102416541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:22.168206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cd1ad-c30e-4025-a58e-eab102416541 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.168490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cd1ad-c30e-4025-a58e-eab102416541 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.168765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cd1ad-c30e-4025-a58e-eab102416541 None admin] PATH_INFO: `/v3/projects/b55401b6f7164ec1b40688c01754b91f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.170055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cd1ad-c30e-4025-a58e-eab102416541 None admin] RBAC: Authorizing `identity:get_project(project_id=b55401b6f7164ec1b40688c01754b91f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:22.171542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cd1ad-c30e-4025-a58e-eab102416541 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:22.177226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 211/414] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:21 2022] GET /identity/v3/projects/b55401b6f7164ec1b40688c01754b91f => generated 345 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:22.179453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.196017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034a710-8e1b-48ab-b99f-ae535bd5b97f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.196326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034a710-8e1b-48ab-b99f-ae535bd5b97f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.196631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034a710-8e1b-48ab-b99f-ae535bd5b97f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.198513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 212/415] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:22.212238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.212781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.212896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.230423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.240113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:22.241368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:22.350048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 213/416] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:22.374096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.384572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1001c6-d54e-4503-b54b-c59fbd369b7e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:22.460761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a1cf3-81f2-4054-bb7e-381f008dc652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:22.461732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a1cf3-81f2-4054-bb7e-381f008dc652 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.462024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a1cf3-81f2-4054-bb7e-381f008dc652 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.462443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a1cf3-81f2-4054-bb7e-381f008dc652 None admin] PATH_INFO: `/v3/projects/b55401b6f7164ec1b40688c01754b91f/groups/a261b1acda9c4c9b8cc7a8c0f676d061/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.474036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a1cf3-81f2-4054-bb7e-381f008dc652 None admin] RBAC: Authorizing `identity:create_grant(project_id=b55401b6f7164ec1b40688c01754b91f, group_id=a261b1acda9c4c9b8cc7a8c0f676d061, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:22.475516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a1cf3-81f2-4054-bb7e-381f008dc652 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:22.496402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 204/417] 10.222.0.113 () {58 vars in 1447 bytes} [Mon Jul 25 19:05:22 2022] PUT /identity/v3/projects/b55401b6f7164ec1b40688c01754b91f/groups/a261b1acda9c4c9b8cc7a8c0f676d061/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:22.514998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.523534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663437b-25ae-49d1-8a58-58dd55ca2d9b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:22.575597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:22.576461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.576745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.577024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.585745 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132fe2-f905-4f36-b070-4d581e3b7911 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.586053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132fe2-f905-4f36-b070-4d581e3b7911 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.586306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132fe2-f905-4f36-b070-4d581e3b7911 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.588097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 205/418] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:22.593779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.594075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.594331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.616699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:22.616894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:22.617983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:22.631467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:22.632607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:22.633600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 214/419] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:22.639197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.698340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 206/420] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:22.746166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.773887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.809672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4ca0-0106-4b41-88a0-07da4930968a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:22.847972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:22.849241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.849730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.850200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.851169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:22.851759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:22.853628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:22.858746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ad34f-3b40-4aba-84bd-a07ba677fd59 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:22.868153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 215/421] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:22.869995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.891026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.897234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:22.898052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.898331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.898625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.910422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:22.927112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:22.928343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:22.929359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 207/422] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:22.934172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.056926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802961bf-f7f8-4b8e-b290-69193c015dd5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.093514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.143397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d312ac6-2c4d-4eb4-bec6-81d3ed449fa9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.145530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf11980-c059-4de2-9f5d-dea217702f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.146197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf11980-c059-4de2-9f5d-dea217702f0b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.146473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf11980-c059-4de2-9f5d-dea217702f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.146749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf11980-c059-4de2-9f5d-dea217702f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.217851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.218920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.219406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.219995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.221020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:23.221639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.223212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.242531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 208/423] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.248789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.281185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf11980-c059-4de2-9f5d-dea217702f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.282726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf11980-c059-4de2-9f5d-dea217702f0b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.319111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.415362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34557a4f-ff86-4692-a4ac-9fb78c96fdc6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.446131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 216/424] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:23.448446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09973ef-d191-4ac0-aa1c-72e5db7ac830 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.449064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09973ef-d191-4ac0-aa1c-72e5db7ac830 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.449510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09973ef-d191-4ac0-aa1c-72e5db7ac830 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.454973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 217/425] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:23 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:23.454973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09973ef-d191-4ac0-aa1c-72e5db7ac830 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.473731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.474744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.475212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.475776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.486462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.555134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.557331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.566090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09973ef-d191-4ac0-aa1c-72e5db7ac830 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.585301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.604193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1a012-c12b-4a74-8b75-ff1436387b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.605081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1a012-c12b-4a74-8b75-ff1436387b2f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.605395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1a012-c12b-4a74-8b75-ff1436387b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.605674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1a012-c12b-4a74-8b75-ff1436387b2f None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.607206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1a012-c12b-4a74-8b75-ff1436387b2f None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.608668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1a012-c12b-4a74-8b75-ff1436387b2f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.610782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 218/426] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.611725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.612011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.612287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.635034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:23.636258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:23.675025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 209/427] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:23.676184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.706056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 219/428] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:23.711143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.731522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.811692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0a3c7-a27e-4d6d-af38-23451ff123f3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.816345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314040-54bd-4b43-814b-88e927ea8d74 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.831578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.849795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.850919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.851295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.851666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.853058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.853879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.854763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.854902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.855041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.855314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] PATH_INFO: `/v3/projects/59756a7f62e24aa090a0fc1a4171fde5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.856815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] RBAC: Authorizing `identity:get_project(project_id=59756a7f62e24aa090a0fc1a4171fde5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.857176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 210/429] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.858038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.858324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.863808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 220/430] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/projects/59756a7f62e24aa090a0fc1a4171fde5 => generated 299 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.867036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.997379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085259-0cbd-4fea-80f1-876d60f69920 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.997894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d23e-63e1-4563-82ca-58e1824c09c6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.005631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.034857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.035630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.035926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.036180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.037029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:24.037443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.037994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.038911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.039144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.039568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.039983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.049217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 221/431] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 613 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:24.049217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.063082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:24.076902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:24.077947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:24.078756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 211/432] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:24.084192 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.113560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.166472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99d728-0b59-4a66-a781-5675c301c0f9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.238037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75a8b-e6a6-4ce4-8436-f93307a12e3c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.254081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.255217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.255639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.256048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.257541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.259225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.266166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 222/433] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:24.272151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.276551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.285158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.285158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.285158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.285158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:24.285158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.285158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.290574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 212/434] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:24.302357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.335433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.423738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd201f7-e6c5-44f8-a014-056d1d68ccee None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.445974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49010b-7b7b-4dc3-9983-53b7f8aa562f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.463816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.464611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.464902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.465211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.471550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.495852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.496610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.496958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.497326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.498228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=59756a7f62e24aa090a0fc1a4171fde5) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:24.498545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.499995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d634c0-b649-4fb6-8c3e-ca9f355dae22 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.510330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 223/435] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=59756a7f62e24aa090a0fc1a4171fde5&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 613 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:24.517618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57396-5c14-4f71-b435-a2889e27a178 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.518239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57396-5c14-4f71-b435-a2889e27a178 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.518717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57396-5c14-4f71-b435-a2889e27a178 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.520490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 224/436] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:24.526546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.526919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.527276 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.548693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:24.550237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:24.551188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.552826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.585586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.644316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 225/437] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:24.667682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.680040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 213/438] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:24.686280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.807004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944799c5-321e-4ef5-885f-fbe744522372 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.818461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.820847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a24eb6-d8b4-4eae-a063-75041759a6ae None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.859148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.860252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.860626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.860911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.861897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.874756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.875777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.875894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:24.876235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.876605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.878027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.879615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.882080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 214/439] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:24.890092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:24.890996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:24.893717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:24.894886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 226/440] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:24.903211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.056150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5d22-6ca4-4be9-b279-8f0eddac7f6f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.059353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d504d-e601-4976-9031-ef1c1e7ae9f9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.096143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d0af7-03e1-4936-b51d-69646b2f8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.097112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d0af7-03e1-4936-b51d-69646b2f8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.097428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d0af7-03e1-4936-b51d-69646b2f8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.097702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d0af7-03e1-4936-b51d-69646b2f8ad0 None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.098946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d0af7-03e1-4936-b51d-69646b2f8ad0 None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.101570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d0af7-03e1-4936-b51d-69646b2f8ad0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.103952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 215/441] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:25.105246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1761c-4fdf-4fd5-9d6b-7979eac19465 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.105532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1761c-4fdf-4fd5-9d6b-7979eac19465 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.105807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1761c-4fdf-4fd5-9d6b-7979eac19465 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.107451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 216/442] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:25.113202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.113497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.113626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.113801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.114160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.114450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.114732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.115619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:25.116000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.117639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.130764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 227/443] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:25.131704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.135800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:25.137811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:25.167501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.211380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.221607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 217/444] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:25.222073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.270890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f18a3-ad65-4cc6-8d12-9a2360544427 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.320535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.321616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.322094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.322584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.323850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=48a5339c8e664d73b4d1667aa69648a8, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:25.324380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.327048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.331613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234affc-9a0f-4547-91ee-c5a7253c5db6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.344132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 228/445] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=48a5339c8e664d73b4d1667aa69648a8 => generated 613 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:25.344132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.395588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.396282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.396566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.396834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.469367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.474321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.480050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.481921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.485508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312d8a-161a-4f18-87b6-a0cb42d2eef3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.527917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.530059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.530531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.530955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.547093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:25.555023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:25.556011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:25.557580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:25.561263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 229/446] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:25.564307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.611543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 218/447] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:25.617471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.700630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace67f-dee8-423b-9585-70e1c612896f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.742384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.750315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28601ea4-0a08-451f-9828-a5d68f0af0f8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.753438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.754167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.754500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.754828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.755687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:25.756053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.757527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.766965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 230/448] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:25.772920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.786167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.787051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.787336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.787614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] PATH_INFO: `/v3/projects/0dd0d9ac4afb4cea8b9976807764c170` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.788819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd0d9ac4afb4cea8b9976807764c170)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.790476 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.792153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 219/449] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/projects/0dd0d9ac4afb4cea8b9976807764c170 => generated 303 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:25.793626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.797782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.880464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1b4bd-9a09-4124-9484-098a560a4358 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.905890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd2f4-800f-4085-90d2-33dcf3e8e0d9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:25.915004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.915928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.916098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.916387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.942649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:25.943508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:25.943792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:25.944073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] PATH_INFO: `/v3/groups/5f82abe0dfe144c98839ae6390d9b82c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:25.945291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] RBAC: Authorizing `identity:get_group(group_id=5f82abe0dfe144c98839ae6390d9b82c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.947510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:25.949391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 220/450] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/groups/5f82abe0dfe144c98839ae6390d9b82c => generated 227 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:25.955082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:25.987239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:25.987892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:25.989657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:26.008108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:26.072539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d14215-c9de-4804-b335-22e959f0ceec None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:26.096824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 231/451] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:05:26.102715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:26.107786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:26.108454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:26.108740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:26.109022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:26.109909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] RBAC: Adding query filter params (group.id=5f82abe0dfe144c98839ae6390d9b82c, role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=0dd0d9ac4afb4cea8b9976807764c170) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:26.110220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:26.111740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:26.117840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 221/452] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:25 2022] GET /identity/v3/role_assignments?group.id=5f82abe0dfe144c98839ae6390d9b82c&scope.project.id=0dd0d9ac4afb4cea8b9976807764c170&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 613 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:26.226930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929cf8d-457a-4a4a-ba65-cabf45910180 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:26.252863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:26.273302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:26.274182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:26.275283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:26.275283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] PATH_INFO: `/v3/projects/b55401b6f7164ec1b40688c01754b91f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:26.276604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] RBAC: Authorizing `identity:get_project(project_id=b55401b6f7164ec1b40688c01754b91f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:26.278108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:26.279850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 232/453] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:26 2022] GET /identity/v3/projects/b55401b6f7164ec1b40688c01754b91f => generated 345 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:26.285731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:26.395344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:26.403143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4ef8-fa3e-4e92-ab5e-023a2bfa4b17 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:26.439894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f810d-0cc3-44a1-a58f-8df01bece899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:26.440841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f810d-0cc3-44a1-a58f-8df01bece899 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:26.441185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f810d-0cc3-44a1-a58f-8df01bece899 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:26.441473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f810d-0cc3-44a1-a58f-8df01bece899 None admin] PATH_INFO: `/v3/groups/a261b1acda9c4c9b8cc7a8c0f676d061` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:26.442703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f810d-0cc3-44a1-a58f-8df01bece899 None admin] RBAC: Authorizing `identity:get_group(group_id=a261b1acda9c4c9b8cc7a8c0f676d061)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:26.444185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f810d-0cc3-44a1-a58f-8df01bece899 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:26.445871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 222/454] 10.222.0.113 () {56 vars in 1185 bytes} [Mon Jul 25 19:05:26 2022] GET /identity/v3/groups/a261b1acda9c4c9b8cc7a8c0f676d061 => generated 230 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:26.452128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:26.559984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64094-425d-484d-8161-55dbcf8cbbcb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:26.594576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:26.595248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:26.595643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:26.595807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:26.596666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] RBAC: Adding query filter params (group.id=a261b1acda9c4c9b8cc7a8c0f676d061, role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=b55401b6f7164ec1b40688c01754b91f) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:26.596949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:26.598442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af92f-2217-4e7a-a1bd-9572556a9b5d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:26.604713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 233/455] 10.222.0.113 () {56 vars in 1381 bytes} [Mon Jul 25 19:05:26 2022] GET /identity/v3/role_assignments?group.id=a261b1acda9c4c9b8cc7a8c0f676d061&scope.project.id=b55401b6f7164ec1b40688c01754b91f&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 613 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:29.275737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346803-e9b7-4e72-93b9-93f68420a7c0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.276603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346803-e9b7-4e72-93b9-93f68420a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.277031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346803-e9b7-4e72-93b9-93f68420a7c0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.278848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 223/456] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:29.284768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.285720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.286204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.314206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:29.315800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:29.362119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8a3d1-8426-4419-a4a2-36606c330355 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.362753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8a3d1-8426-4419-a4a2-36606c330355 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.363233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8a3d1-8426-4419-a4a2-36606c330355 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.365081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 224/457] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:29.370734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e7d6-f428-4141-9dd3-8e3c764ea9bd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.371336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e7d6-f428-4141-9dd3-8e3c764ea9bd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.371815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e7d6-f428-4141-9dd3-8e3c764ea9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.371918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:29.396594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 234/458] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:29.421106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:29.426203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0b17e7d6-f428-4141-9dd3-8e3c764ea9bd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:29.427715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0b17e7d6-f428-4141-9dd3-8e3c764ea9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:29.531228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71d1d-1873-4172-a780-657b24719daf None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:29.573071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:29.573945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.574228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.574502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.578539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 225/459] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:29.580184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54d65-8ff7-4fb9-beb0-546fd13aa6ab None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.580474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54d65-8ff7-4fb9-beb0-546fd13aa6ab None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.580750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54d65-8ff7-4fb9-beb0-546fd13aa6ab None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.585150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 226/460] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:29.587883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.588275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.588656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.601086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:29.607031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:29.609513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:29.611060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:29.626335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:29.627251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:29.628675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:29.628675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:29.628675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:29.628675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:29.628675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 235/461] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:29.628675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:29.660546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:29.697292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 227/462] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:29.698165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:29.745446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:29.752680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b80e-8eb8-4874-9dee-edd8cdaf3384 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:29.789492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:29.790322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.790915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.790915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.803150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:29.804642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:29.830979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:29.833751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:29.836642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:29.836642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:29.836642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:29.836642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:29.837986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 236/463] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:29.838268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:29.845408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1cb65-2d81-4b41-ba92-c60eb53a32ae None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:29.901867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:29.902547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.902830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.903103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.904268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:29.904268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:29.905561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61615086-352d-444d-81a0-36ef6eab4b3e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:29.918857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 228/464] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:29.920232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaf56d-ebb1-4935-9441-5b97937bff90 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.920518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaf56d-ebb1-4935-9441-5b97937bff90 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.920797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaf56d-ebb1-4935-9441-5b97937bff90 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.922189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 229/465] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:29.922744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaf56d-ebb1-4935-9441-5b97937bff90 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:29.948692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:29.970907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce19472-8650-43b6-af1c-c40a0d9a7d8b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.008624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.009490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.009771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.010042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.012982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.021294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.022781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.034342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaf56d-ebb1-4935-9441-5b97937bff90 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:30.040135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:30.040971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:30.042168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:30.042168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:30.042168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:30.042168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:30.042168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 237/466] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:30.043476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.079018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.079787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.080140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.081102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.081234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:30.081634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.083096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87f0f4-1e4e-4f4d-837d-29aa33d879e2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.096587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 230/467] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:30.097967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.098263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.098543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.119382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:30.120860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:30.152713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c06d-f90c-44e2-8047-60f1e24458ac None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.188689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.189509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.189859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.190200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.190979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.192503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.200916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.217147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 231/468] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:30.217147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.225278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 238/469] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:30.226170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.318810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.357384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ee85-f681-404d-b810-f0d25c7b826c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.370728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060b8b2-3a17-42ab-8489-d483de39a920 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.417418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ce81-0bf4-4c35-90c1-a5db4d6681e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.417997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.418519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ce81-0bf4-4c35-90c1-a5db4d6681e7 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.418714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.418811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ce81-0bf4-4c35-90c1-a5db4d6681e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.419055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ce81-0bf4-4c35-90c1-a5db4d6681e7 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.419777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ce81-0bf4-4c35-90c1-a5db4d6681e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.419871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.420097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.420843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:30.421175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.421349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ce81-0bf4-4c35-90c1-a5db4d6681e7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.422644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.437294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 232/470] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:30.438356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.446094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 239/471] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/users => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:30.448718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425c0bd-b2bf-4501-9d63-03a7b3a72a08 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.449187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425c0bd-b2bf-4501-9d63-03a7b3a72a08 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.449636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425c0bd-b2bf-4501-9d63-03a7b3a72a08 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.451291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 240/472] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:30.451881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425c0bd-b2bf-4501-9d63-03a7b3a72a08 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.518317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.581072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75059-ac2e-42ac-bb51-f20be755c974 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.594966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425c0bd-b2bf-4501-9d63-03a7b3a72a08 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.623293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.630600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.631957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.632246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.632526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.645862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946d6fc-2a99-40f1-9115-6a619eee7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.646697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946d6fc-2a99-40f1-9115-6a619eee7829 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.646907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946d6fc-2a99-40f1-9115-6a619eee7829 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.647192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946d6fc-2a99-40f1-9115-6a619eee7829 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.647996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946d6fc-2a99-40f1-9115-6a619eee7829 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.648282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.649697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946d6fc-2a99-40f1-9115-6a619eee7829 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.650457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:30.673343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:30.674264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:30.675127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:30.675127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:30.675127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:30.675127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:30.676065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 241/473] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:30.677529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.677826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.678154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.685570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 233/474] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:30.686995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.700740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:30.702230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:30.793254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 242/475] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:30.819795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.858986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62de57-7e21-4c58-a9ce-9db1aa545df1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.863064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.918202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.919472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.919760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.920318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.921072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:30.922155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.924445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.942807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 234/476] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:30.948469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.967763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4175e-b407-4ff6-9a15-d2f1140b9762 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:31.009744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:31.010507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:31.010831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:31.011231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:31.012010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:31.013492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:31.019918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:31.021990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.sql.core [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 19:05:31.021990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 19:05:31.021990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [parameters: {'id': '121776ccf8a24a679b78c7f26be381f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 19:05:31.021990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80507) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 25 19:05:31.043677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:05:31.045053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application yield resource Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise self.value Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application session.commit() Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 19:05:31.046038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.flush() Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application compat.raise_( Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 19:05:31.046892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:05:31.048370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:05:31.050762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [parameters: {'id': '121776ccf8a24a679b78c7f26be381f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:31.052686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 19:05:31.054656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:31.056948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 243/477] 10.222.0.113 () {60 vars in 1136 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:31.056948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:31.115664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bcbc2-c19c-4bda-bdb2-78d2d9601b26 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:31.161030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:31.161770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:31.162325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:31.162433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:31.163093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:31.164650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:31.182703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:31.191691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908518d-0a81-47f2-99f1-70837240ac1c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:31.200381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 235/478] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/users => generated 250 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:31.245213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5277d-c884-46c1-b7cf-38592d863a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:31.246578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5277d-c884-46c1-b7cf-38592d863a96 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:31.246860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5277d-c884-46c1-b7cf-38592d863a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:31.247137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5277d-c884-46c1-b7cf-38592d863a96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:31.263577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5277d-c884-46c1-b7cf-38592d863a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-04f5277d-c884-46c1-b7cf-38592d863a96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:31.272549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:31.273562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:31.274702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 244/479] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:31.281977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:31.422985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:31.426960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc31e-c123-47f6-b352-2d234456844f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:31.475296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:31.476382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:31.476855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:31.477348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:31.478426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:31.478960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:31.480620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496013c1-31c2-4e67-aa33-1911bc140e23 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:31.494561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 236/480] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:32.792782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0cb6-d84b-4e03-8ae0-a13b07d5e3c4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:32.793358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0cb6-d84b-4e03-8ae0-a13b07d5e3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:32.793358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0cb6-d84b-4e03-8ae0-a13b07d5e3c4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:32.794889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 245/481] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:32.800473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:32.801159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:32.801159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:32.825252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:32.826455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:32.897763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 237/482] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:32.932103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0cb6-d84b-4e03-8ae0-a13b07d5e3c4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:33.114772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0cb6-d84b-4e03-8ae0-a13b07d5e3c4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:33.166578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:33.167408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.167686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.167961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.184027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:33.191835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:33.192891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:33.194053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 246/483] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:33.199005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:33.339618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:33.353078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188df77-3e0f-47f0-bfd1-cef4f3590ccf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:33.427119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:33.427819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.428104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.428380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.429175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:33.429487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:33.431090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ef575-8e48-4a4e-a951-38789cadf6b1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:33.444578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 238/484] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:33 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:33.450353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:33.496671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:33.556181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb31c0-ed7c-4292-83c2-2b2faa98b246 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.556552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb31c0-ed7c-4292-83c2-2b2faa98b246 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.556741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb31c0-ed7c-4292-83c2-2b2faa98b246 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.558416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 239/485] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:33.560918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea92f44-68e4-4518-9e3a-d2a3e6df7d62 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.561242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea92f44-68e4-4518-9e3a-d2a3e6df7d62 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.561530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea92f44-68e4-4518-9e3a-d2a3e6df7d62 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.562980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 240/486] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:33.567821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086270c1-95d7-462d-878a-298c2a6b0e63 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.568115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086270c1-95d7-462d-878a-298c2a6b0e63 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.568398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086270c1-95d7-462d-878a-298c2a6b0e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.588164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-086270c1-95d7-462d-878a-298c2a6b0e63 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:33.589580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-086270c1-95d7-462d-878a-298c2a6b0e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:33.613813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43b079-6565-4b73-bac7-d20f6726de99 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:33.653234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:33.655021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.655502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.655989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.671585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:33.673349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:33.681140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 241/487] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:33.681140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.681140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.681140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:33.702807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:33.703722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:33.704582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:33.704582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:33.704582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:33.704582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:33.706991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 247/488] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:33.712434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:33.712691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:33.715318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:33.804269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 242/489] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:33.805980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:33.806545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:33.830249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:33.860650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164fce-8029-487e-91db-6035c7ce4207 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:33.898292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:33.899241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.899645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.899928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.912137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:33.920831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:33.921792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 248/490] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:33.928005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:33.940306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ec4b1-4e5c-4655-a482-e71e405b6473 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:33.981231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:33.982655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:33.983163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:33.983634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:33.984565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:33.985619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:33.987565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.004039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 243/491] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.005288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.042684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db20c16-6bce-461e-aff5-8d4bd34ee7e5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.072662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.081532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5664a-16f5-44f5-8590-93afdcdb24a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.082362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5664a-16f5-44f5-8590-93afdcdb24a5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.082647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5664a-16f5-44f5-8590-93afdcdb24a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.082923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5664a-16f5-44f5-8590-93afdcdb24a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.087940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.098024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5664a-16f5-44f5-8590-93afdcdb24a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-09e5664a-16f5-44f5-8590-93afdcdb24a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:34.106798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.107700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:34.108569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 249/492] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.109883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907a1e-8971-4c14-94c8-ae4fb674239f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.110106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907a1e-8971-4c14-94c8-ae4fb674239f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.110380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907a1e-8971-4c14-94c8-ae4fb674239f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.115670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 250/493] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.115670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36907a1e-8971-4c14-94c8-ae4fb674239f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.122731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fbf6b-193a-4c50-9e5d-e2066c673d4c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.173815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.174458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.175156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.175455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.176218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:34.176524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.178594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.187388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 244/494] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.190013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.243503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36907a1e-8971-4c14-94c8-ae4fb674239f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.277817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.278622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.278906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.279181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.286856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.288331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.294243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850749bb-a536-458c-af51-4a74e086eec5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e1cff4e5-63dd-4d3b-a422-ac7fd031945a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:34.304271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.305305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:05:34.306534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:34.309493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 251/495] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.311187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b040-d48d-48d8-a2bd-204e89dc06e4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.311477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b040-d48d-48d8-a2bd-204e89dc06e4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.311773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b040-d48d-48d8-a2bd-204e89dc06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.328455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.329147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.329435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.329713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.330462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:34.330566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-42a5b040-d48d-48d8-a2bd-204e89dc06e4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:34.330766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.331692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-42a5b040-d48d-48d8-a2bd-204e89dc06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:34.332303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.334506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.342352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 245/496] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.343121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.380106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.406198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 252/497] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:34.407795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605497d-0dc2-4738-93f1-adcec4cd9399 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.408086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605497d-0dc2-4738-93f1-adcec4cd9399 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.408363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605497d-0dc2-4738-93f1-adcec4cd9399 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.409908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 253/498] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.410620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605497d-0dc2-4738-93f1-adcec4cd9399 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.454097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64342b5-6d42-4348-bf76-929a08618597 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.488261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.489081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.489400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.489681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.500644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.502154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:34.519472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.520439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.521315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:34.521315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:34.521315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:34.521315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:34.521522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605497d-0dc2-4738-93f1-adcec4cd9399 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.521593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 246/499] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.521593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.557862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.558552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.558835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.559113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.559948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:34.560261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.561757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c11de-cbd8-4d76-8f95-0d7f518e24f9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.575375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.598993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 254/500] 10.222.0.113 () {56 vars in 1142 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.600391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.600687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.600965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.619893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:34.621094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:34.627871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cf60d-9569-4cc8-9928-bd12b1a10b93 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.651788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.664197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.665054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.665407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.665726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.677144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.678593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.691713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 255/501] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:34.692639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:34.697486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.698411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.699247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:34.699247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:34.699247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:34.699247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:34.699247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 247/502] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.699247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.803018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c66c54-cc10-4f5e-9e46-9060aeddbcce None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.803918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240b75-3fba-4791-9f60-310f6c6963b5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.805513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.841824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.842381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.842632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.842942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.843137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.843232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.843311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.843553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.844281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:34.844586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.845999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.854276 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.856090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.858644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 248/503] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.859497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:34.876306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.877517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.878859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:34.878859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:34.878859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:34.878859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:34.878859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 256/504] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.878859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.898863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.974646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e9e9-57c5-4338-b26e-5664699037c7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.997860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879572a3-2a03-4b29-89b7-5bc7c2e5ef85 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.012549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.013237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.013594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.013594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.036292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.037154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.037303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.037627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.038380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:35.038682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.040599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.052739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.056143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 257/505] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.057233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.097759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.099248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.141330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.164263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2ae35-3973-4e7a-a0b3-677cc985e8a1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.200838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 249/506] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:35.201337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.201718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.202228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.202516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.202793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.214825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:35.222934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:35.223861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:35.224635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 258/507] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:35.225341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.269428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.319859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447a1b3-50b4-455f-bcd5-2d2282d2defc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.332040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc399e2-f503-4e65-a2d5-d579833988e7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.355587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.356699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.356985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.357291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.364568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.366049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.367479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.368271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.368549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.368822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.369550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:35.369855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.371218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.378634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.384806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 259/508] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:35.385580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:35.386458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:05:35.387359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:35.387874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.388005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 250/509] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:35.388005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.491610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b664-0c0a-40fe-a7e8-1f386f018d77 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.493898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5d791-4b1a-42f8-b28a-9925fef17c38 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.514409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.531568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.532410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.532697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.532978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.533371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.534189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.534480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.534758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.543900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.545258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.545410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.546784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:35.560756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:35.561738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:35.562647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 260/510] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:35.563929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:35.564794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:35.565661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:35.567720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:35.567720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:35.567720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:35.567720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:35.567720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 251/511] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:35.567720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.635442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.676586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d4eec-8587-4d54-a4d1-7d7df1d40e1a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.678974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc204b-c009-4d49-a3b7-df29ab6a7564 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.713249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.713928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.714213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.714487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.715342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:35.715652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.716147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.716818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.717088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.717207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.717392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.718128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:35.718430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.719809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.728377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 261/512] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.729169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.756081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 252/513] 10.222.0.113 () {56 vars in 1142 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.756932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.793365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.836378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647f148-374b-4768-a808-4a79bdcaf8dd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.857030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.863986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa428-98ee-48e0-bff8-094be763756a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.874191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.874883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.875507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.875789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.876654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.878147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.899300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.899899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.900180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.900316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 262/514] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:35 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:35.900464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.901039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.901324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:35.901631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.903096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.924163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 253/515] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.924791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.025080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.042937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd391-c31b-4133-a4f2-24655bd2031f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.052534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546c926-4613-4770-9a0e-d84343343ac8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.085924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.087105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.087977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.087977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.093669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.094353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.094635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.094955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.095686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:36.096006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.102491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.102639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.102639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.111437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 263/516] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.112623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:36.124061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:36.124985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:36.125908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:36.125908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:36.125908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:36.125908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:36.129208 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 254/517] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:36.131424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.155004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.250024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f18af8-98a1-4840-885d-80324909600f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.256627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526845-c4f2-4ed2-a12d-cf193a4fe946 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.293449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.293802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.294120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.294404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.294517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.294681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.294773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.294952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.308202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.370251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.372113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.377754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.379244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.417367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.487610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 255/518] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:36.488943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.496359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 264/519] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:36.497072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.547430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.620245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50e5e-c9be-46cc-a4d2-fc367a2c96b7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.620669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a349b9c-62fb-440d-b90e-4af93a12e1c1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.657761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.658556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.658840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.659115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.666521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.667446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.668006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.668106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.668325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.668594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.669335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:36.669638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.671153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.674360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:36.684198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:36.685094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:36.685986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:36.686413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 265/520] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.686483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 256/521] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:36.686547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.686620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.794980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2b7f-0617-41f8-9a40-557f05a869e4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.796543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.808668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936540e4-7ad4-4e95-b9c2-8cb326e37090 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.832445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.833390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.833792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.834070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.845693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.845919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.846629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.847002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.847349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.847441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.859108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.860629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:36.866523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:36.867633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:36.869921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:36.869921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:36.869921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:36.869921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:36.869921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 257/522] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:36.869921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:36.883102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:36.884228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:36.885103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:36.885103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:36.885103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:36.885103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:36.888892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 266/523] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:36.889791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.942929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.982817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304c743-0f6d-4eb9-b343-21afd5b5be1f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.001786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb925-caa1-404a-b90b-f888cd5aa220 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.025657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.025657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.025657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.025657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.026250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.026439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.028113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.047822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 258/524] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.048739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.062709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.063548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.063829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.064104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.070023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.074018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.075526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:37.092782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:37.094066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:37.094980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 267/525] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:37.095538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.172406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b310589-951a-4d81-bd55-d155978b17f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.208124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.208525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367dc2c-3ca4-4b62-9f6b-777bc9fbd0eb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.208712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.208994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.209298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.210128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.210437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.212224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.218608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.225004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 259/526] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.226016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.250014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.250689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.250970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.251246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.251948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.252251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.253674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.266203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 268/527] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.267014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.315826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.355575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540126a-2477-4195-bc84-8bcdc47f8a63 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.381470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3d0a8-7e63-4717-b990-36363fbcd326 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.409287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.409955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.410390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.410670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.411907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=59220145172c436b8995414a68d94bfd) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.412221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.413708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.419514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 260/528] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/role_assignments?user.id=59220145172c436b8995414a68d94bfd&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.419768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.420301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.421032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.421543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.422007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.423070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.423449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.425052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.454980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 269/529] 10.222.0.113 () {56 vars in 1144 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.454980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.491101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.553737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc6df-2e42-4dac-bae1-8ba74ac92636 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.594694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32088f-4b0e-402b-9793-1f3e0431a9e8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.595192 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.596195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.596736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.597974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.606510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.608363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.611673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:37.627159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:37.628082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:37.628923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:37.631264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 261/530] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:37.632300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.646220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.647066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.647354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.647797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.658296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.660125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:37.679663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:37.681849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:37.683557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:37.685793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 270/531] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:37.686694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.760338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3308-7210-43c4-9e54-936b83219c61 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.798022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.809063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.809923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.810219 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.810560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.817431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab34525-6c92-4e31-b788-731658238502 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.854291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.855356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.856139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.856672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.857706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.858233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.859945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.880071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 271/532] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.881280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.891901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.897665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.899188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.991600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b3ab0-3aba-4b02-955c-7602c675df43 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.021546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 262/533] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:38.022317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.032027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.032636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.032921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.033255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.034419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:38.034419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.035809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f37d7-822b-49b2-bf81-19bc2a0bba2b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.049419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 272/534] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:38.051043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae8361-0017-4f17-949d-72bfb52b4284 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.051544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae8361-0017-4f17-949d-72bfb52b4284 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.051997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae8361-0017-4f17-949d-72bfb52b4284 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.053457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 273/535] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:38.054323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae8361-0017-4f17-949d-72bfb52b4284 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.064331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.135417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.139972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8fee-3341-45a9-bdce-a0d3b20f9f8c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.167719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae8361-0017-4f17-949d-72bfb52b4284 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.176718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.177424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.177717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.177997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.178838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=e0573ae51c744a45aeca013357431eb0) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:38.179157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.180716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.197155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 263/536] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/role_assignments?user.id=e0573ae51c744a45aeca013357431eb0&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:38.197155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.215377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.216433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.216787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.217142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.231371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.233346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6869ea47-47e9-4abd-96d5-c494392d62e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:38.257427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:38.258427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:38.259753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:38.259753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:38.259753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:38.259753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:38.261467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 274/537] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:38.262762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.263049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.263325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.295785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:38.297588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:38.326142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d443a1-7e45-4621-b829-1f29469cc16b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.366110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.366801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.367085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.367390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.368022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.368312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=15cfb6d527464ccaad7db841e3eacf7c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:38.368628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.371147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.381193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 264/538] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/role_assignments?user.id=15cfb6d527464ccaad7db841e3eacf7c&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:38.381193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.395537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 275/539] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:38.420621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.445428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.541543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599f6fe-c7f3-42ba-9602-bb55db2f4bc6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.596039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.596733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.597017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.597327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.598078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:38.598387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.599821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.625164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 265/540] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:38.634771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.666371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b16f-2442-4d3d-896f-7191e5903364 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.741999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.742953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.743235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.743604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.768269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.768466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:38.777661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:38.778631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:38.779425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 276/541] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:38.785068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.804343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b276de-0bd0-4b9e-8753-02186e2ef3f6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.873313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.874041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.874325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.874598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.889712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.890649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.892145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:38.912334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:38.913289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:38.914158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:38.914647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 266/542] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:38.923084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.024975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97367755-579c-4ef1-8160-8b6fec88d635 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.109799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4b63-18b5-4ccd-84e9-894cc0bf0faa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.112757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.113452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.113738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.114016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.114782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:39.115086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:39.116516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:39.136849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 277/543] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:39.152002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.169445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.170446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.170855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.171258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.172519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:39.172955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:39.175244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:39.194823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 267/544] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:39.201316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.220803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:39.351469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2fa8-ecbd-4dae-89d0-368da7913299 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.417915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.418939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.419433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.419918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.420981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=b58dcd8f33cb40fc9580af1fa294e369) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:39.421523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:39.424512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:39.434964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2457d5-2861-4447-89cc-532e052c149c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.439450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 268/545] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/role_assignments?user.id=b58dcd8f33cb40fc9580af1fa294e369&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:39.453598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:39.483087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.484347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.484854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.485520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.498502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:39.500477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-31efb248-47c9-4242-9015-bedadaaac6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:39.520582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:39.521594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:39.522500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:39.522500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:39.522500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:39.522500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:39.524908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 278/546] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:39.530822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.630334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:39.668870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9775a9-f961-43ce-95e9-1a299f6a401d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.687464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491650a4-ef52-487d-b0f4-e1bfcdc83bee None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.688149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491650a4-ef52-487d-b0f4-e1bfcdc83bee None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.688683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491650a4-ef52-487d-b0f4-e1bfcdc83bee None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.690687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 279/547] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:39.697167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.697838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.698312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.719937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:39.721623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:39.734000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.734701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.734990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.735273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.736247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:39.736359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:39.737779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:39.761638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 269/548] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:39.770220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.869112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 280/549] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:39.907420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.984029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc5e5c-5b13-438a-83cc-0252a23b1a1d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.072027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.089346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.090158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.090444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.090727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.103891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.105400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:40.128910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:40.130460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:40.131550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 270/550] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:40.144616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.144810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.173028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c867e90-6e71-40dd-8049-d2e30c72261b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.277984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.278756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.279050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.279327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.316311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:40.324329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:40.325347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:40.326338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:40.327475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc51c-9359-46d3-936c-efce17a698b6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.338573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 281/551] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:40.344444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.396180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.396894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.397207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.397509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.398395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:40.398704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.401165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.446857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 271/552] 10.222.0.113 () {56 vars in 1140 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:40.454200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.546669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd6f6-78da-4ec6-a769-9c9ddc48b701 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.589019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.590147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.590636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.591486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.593141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.597386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:40.597990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.599748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.621524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 282/553] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:40.625453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.667505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.725562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4490d3-11c5-401b-9457-c44d79b1f767 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.774885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a87f4-998e-441e-b934-5490fb7c86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.776027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a87f4-998e-441e-b934-5490fb7c86b3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.776467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a87f4-998e-441e-b934-5490fb7c86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.776880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a87f4-998e-441e-b934-5490fb7c86b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.777193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e219-1be9-478d-99f5-17d7dd641306 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.816257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.817054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.817606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.817606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.835808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.837839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.860134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a87f4-998e-441e-b934-5490fb7c86b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.861664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a87f4-998e-441e-b934-5490fb7c86b3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6e5d222e-e95c-413a-af5b-7ec29db0200e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:40.870297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:40.871272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:40.872321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:40.872321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:40.872321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:40.872321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:40.872321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 283/554] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:40.878387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e50f6-aae3-4684-bd5f-3b56a3c07def None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.878649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e50f6-aae3-4684-bd5f-3b56a3c07def None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.878912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e50f6-aae3-4684-bd5f-3b56a3c07def None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.881151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 284/555] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:40 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:40.881616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234cf3-50fb-46b3-8a49-b8447594dca9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.882424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234cf3-50fb-46b3-8a49-b8447594dca9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.882424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234cf3-50fb-46b3-8a49-b8447594dca9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.883626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 285/556] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:40 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:40.884175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234cf3-50fb-46b3-8a49-b8447594dca9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.925421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.966961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.002784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 272/557] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:41.002784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.002784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.002784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.012465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234cf3-50fb-46b3-8a49-b8447594dca9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.022071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:41.023334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:41.052087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.053359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.053651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.054102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.054958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:41.055279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.057424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef381f-4355-4586-9fe2-622e21d56ea0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.070702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 286/558] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.072172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.072483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.072740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.092975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:41.094365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:41.112407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 273/559] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:41.113600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.194737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 287/560] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:41.196481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.213620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.240515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e98dd-0555-4bd2-8394-cb715c4d3051 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.288910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.290018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.290330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.290625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.303693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.306656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.309752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:41.343751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:41.344857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:41.346436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:41.346436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:41.346436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:41.346436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:41.346856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 274/561] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:41.348217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.365855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af9d2-c73a-40bc-929b-9ee1b7f2b040 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.403768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.404587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.404869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.405165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.413238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.414894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:41.431426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:41.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 288/562] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:41.433549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.473865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc4739-2383-41be-9cef-ec0869e8f77e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.505902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.513500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.514456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.514705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.515087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.528359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:41.536359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:41.537523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:41.538605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:41.543103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 275/563] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:41.544101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.551766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8001318-6ac1-492e-a85b-1fe7ac61c063 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.569343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.591763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.592899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.593263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.593562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.606744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:41.614897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:41.616085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:41.617636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:41.622758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 289/564] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:41.623541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.669743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99b052-4a31-4fd1-ae76-c2363151e220 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.707973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.708664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.709051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.709370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.710115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:41.710426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.711900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.733829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 276/565] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.733829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.766859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad925a-bb59-4c9b-8653-df4bb933e90a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.793642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.814377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.816077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.817246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.818324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.819738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:41.821265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.822993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.844292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 290/566] 10.222.0.113 () {56 vars in 1142 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.849406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.861518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14d80a-80fd-4e43-9d67-f8f5c6550480 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.887131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.903423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.904100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.904392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.904698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.905441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:41.905866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.907129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.916287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 277/567] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.917145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.963117 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316228b-5cc9-48ef-ab56-2bc0acd86b57 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.001673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.002594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.002675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.002897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.003624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.003928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.005448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.017887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 291/568] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.019099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.037295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18ca6-e421-4349-8cd7-a3260fe770e2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.051808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.076126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.076945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.077230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.077543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.084770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.086322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ea871f6f-646c-481f-95e1-6da4da2c6908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:42.101732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:42.103166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:42.104095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 278/569] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:42.104717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e119-92d0-499a-8fec-51521bc19f08 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.104717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e119-92d0-499a-8fec-51521bc19f08 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.105232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e119-92d0-499a-8fec-51521bc19f08 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.106512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 279/570] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:42.107212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297e119-92d0-499a-8fec-51521bc19f08 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.134388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.140690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea88c0f-ca0f-4137-bedb-57832c590c68 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.176184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.177019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.177322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.177599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.191571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.194313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:42.217145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:42.218136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:42.219035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:42.219035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:42.219035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:42.219035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:42.219035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 292/571] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:42.219315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.229006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297e119-92d0-499a-8fec-51521bc19f08 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.265311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.266110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.266406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.266686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.277739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.279323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:42.299526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:42.300617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:42.301674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:42.301674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:42.301674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:42.301674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:42.301674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 280/572] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:42.302198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.332719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1c210-dc0d-49b2-a0ff-69479c0a61f3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.342794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.379820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.380757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.381107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.381444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.393847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.395249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.403950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d0224861-ebec-494f-813c-6fe4a641dcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:42.414403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:42.415592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:42.416658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:42.416658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:42.416658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:42.416658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:42.418816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 293/573] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:42.419878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.420172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.420448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.434266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849aca-76f1-4e67-bf50-b6a2d394f41c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.439302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:42.440524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:42.470916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.471587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.471871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.472146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.472950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.473288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.474771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.492033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 281/574] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.492797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.519478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 294/575] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:42.520328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.608134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.627452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba1c37-f031-4b78-9d31-313cfa4d6cbe None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.636366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e010ac-5670-47b1-862c-66295f72a991 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.664960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.665747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.666134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.666474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.667273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.667604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.669284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.669748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.676933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.677722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.678003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.678654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.679383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.679692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.681777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.683684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 282/576] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.684548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.694922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 295/577] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.696093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.811981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6301-053a-4838-a691-2bb26e8cae43 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.817088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3741-6af9-4d5f-bfcb-387aa23cae3d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.848680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.849676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.849966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.850242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.850967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.851330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.853424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.854581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.855255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.855845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.856124 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.856956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=d2e01af3550b4e638343e176888a21aa) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.857307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.858778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.865856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 296/578] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/role_assignments?user.id=d2e01af3550b4e638343e176888a21aa&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.865856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.877593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 283/579] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.877593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.887281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.947747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.006310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92b98e-1431-46e8-ad64-774a5bbf116b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.037085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896b51-2774-45f6-8206-fc76e171b18c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.051621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.052448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.052730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.053005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.064982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:43.073209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:43.074210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:43.075047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 297/580] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:43.075750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.089356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.090327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.090616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.090895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.100541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.102412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:43.120144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:43.121112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:43.122068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:43.126342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 284/581] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:43.127286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.201825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b2a1d-bbd9-48bc-9424-ef3d73c40c29 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.210396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.222291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.253396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.254325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.254667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.255003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.259586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568a50a-0e4c-4514-80f8-0e679ef23c7c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.263794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.265392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:43.280556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:43.281877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 298/582] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:43.290290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.325203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.326380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.326767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.327514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.336283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.338216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:43.360171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:43.361452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:43.362610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:43.363841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 285/583] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:43.364510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.442246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8b2a-de51-4626-a4bb-d287fcc20320 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.484642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.485507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.485982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.486356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.487240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:43.487595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.489079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.499404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 299/584] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.502356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.508479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa6b9-d0ba-42db-ae02-ac9bdb12d8ba None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.539882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.545371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.561914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.562964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.563447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.563920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.565377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:43.565909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.568390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.594445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 286/585] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.594445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.647655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e28d2-66c5-46a6-b982-85f33e24ce69 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.689224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.690763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.691321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.691876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.693368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:43.693934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.696738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.712546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393856-bdf6-4648-9a55-386095c60dce None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.733830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 300/586] 10.222.0.113 () {56 vars in 1142 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.733830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.777881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.778924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.779808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.779808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.780637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:43.780862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.782388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.805961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 287/587] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.805961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.886508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.906303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.920843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958238fd-9522-4e0c-83df-f15c61f49297 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.979384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.980493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.981254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.981669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec3c23-3761-412c-b0da-949cae73652c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.981774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.009088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.010682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:44.030860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:44.031877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:44.032780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:44.032780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:44.032780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:44.032780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:44.032780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 301/588] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:44.033070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.045432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.047233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.047881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.048113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/59220145172c436b8995414a68d94bfd/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.073437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=59220145172c436b8995414a68d94bfd, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.075019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.092142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 288/589] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:43 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/59220145172c436b8995414a68d94bfd/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:44.106321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.247298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f6040-a851-4651-824b-f16d7d11a31a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.262864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.278095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185385-e125-4c16-85b2-e565f9b2b0a7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.303717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.304339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.304619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.304940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.316661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.318195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.326906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.328121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.329102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.329102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.329621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:44.338691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:44.339953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:44.341075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:44.341075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:44.341075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:44.341075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:44.344746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 302/590] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:44.345685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.348073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.350015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:44.371198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:44.372363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:44.373615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:44.373615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:44.373615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:44.373615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:44.375699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 289/591] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:44.376727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.463622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008c876-c173-4e89-a266-f04bd107f3bd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.496851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c68c5-1248-4f4c-98da-e9ef176354fe None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.502546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.503237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.503523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.503799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.504612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:44.504940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.506401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.519357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 303/592] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:44.520449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.546213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.547288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.547839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.549015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.550397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:44.550852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.552860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.569066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 290/593] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:44.570187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.574373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.590532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.637039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4f1a-3538-4489-aea5-a4589a8bbd59 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.673574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.674267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.674554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.674830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.677211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:44.677542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.679239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.694132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31893e-b136-4813-9d0b-8be31bd207de None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.698784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 304/594] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:44.700265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.737995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.739156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.739668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.740095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.749573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.751339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:44.769211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:44.770373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:05:44.771494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:44.773991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 291/595] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:44.775256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.808880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df0f90-123b-4fd4-be6c-bbfd60a090c6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.828703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.847280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.848097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.848477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.848654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.849859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.857446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.859223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:44.874058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:44.875189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:44.876209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:44.880138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 305/596] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:44.881059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.900210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dcaec-8886-4a06-8e1b-28cba9fed637 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.940749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.942174 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.942627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.943099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.951255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.953049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:44.968665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:44.969808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:44.970923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:44.973147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 292/597] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:44.974330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.990627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8bfa3-3266-4f08-aac4-db7586b64f41 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.029370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.030060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.030523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.030903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.031991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:45.032110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.033766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.054162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 306/598] 10.222.0.113 () {56 vars in 1144 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:45.055487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.092559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.099561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d603a0-cce5-4338-8f4f-ff5579ae4ff5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.135429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.148808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.150363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.150813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.151233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.152295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:45.152810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.154463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.166043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3357-d2ae-4ab2-a8e8-a85def931a1b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.172084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 293/599] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:45.173330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.213732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.214199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.214484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.214765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.215575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:45.215879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.217455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.231136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 307/600] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:45.232088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.299702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3539-841e-47ae-9450-794d4caef806 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.339084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.339894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.340178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.340454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.351956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.353339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.365577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9ed62ccd-8246-4448-94a1-59efb54fd1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:45.372542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:45.373518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:45.374418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:45.374418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:45.374418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:45.374418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:45.379234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 294/601] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:45.379930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdca29c-d61e-452b-900e-d6812c67b39b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.382759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe29c-3e41-433f-940d-ebc03eba5492 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.382759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe29c-3e41-433f-940d-ebc03eba5492 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.382759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe29c-3e41-433f-940d-ebc03eba5492 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.382759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 295/602] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:45.383547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe29c-3e41-433f-940d-ebc03eba5492 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.433740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.435348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.435878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.436148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.436412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/e0573ae51c744a45aeca013357431eb0/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.463494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=e0573ae51c744a45aeca013357431eb0, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.465300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.493160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 308/603] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:45 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/e0573ae51c744a45aeca013357431eb0/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:45.493160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.516443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe29c-3e41-433f-940d-ebc03eba5492 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.573542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fe397-d498-44d5-acb1-83297679e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.574606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fe397-d498-44d5-acb1-83297679e48d None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.575063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fe397-d498-44d5-acb1-83297679e48d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.575346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fe397-d498-44d5-acb1-83297679e48d None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/15cfb6d527464ccaad7db841e3eacf7c/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.599100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fe397-d498-44d5-acb1-83297679e48d None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=15cfb6d527464ccaad7db841e3eacf7c, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.601490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fe397-d498-44d5-acb1-83297679e48d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.622893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 296/604] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:45 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/15cfb6d527464ccaad7db841e3eacf7c/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:45.624344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.624729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.625009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.647691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:45.649421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:45.679627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e361-8fa9-4bda-8343-66e07c2b65f3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.733082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.733981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.734373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.734749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.735600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:45.736025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.739112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.763387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 297/605] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:45.776017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 309/606] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:45.782608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.830412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.833892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.858684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.941284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e569224-0643-4cfd-aa18-df483081b1c3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.992176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.993335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.993777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.994223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.003139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.004844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:46.021754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:46.022962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:46.024059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:46.026738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 298/607] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:46.032505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.038863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea47752-0a1e-4063-9264-322261696cfd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.087392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.088470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.088934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.089377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.116146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:46.124491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:46.125617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:46.126646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:46.133702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 310/608] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:46.141160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.184697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.216417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.233191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7dbe9-e743-40cd-b2f2-3fa4d80b7bd4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.256722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55393f1-3713-4cc5-8119-398c3f70cfb4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.294625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.295568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.296034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.296458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.297413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:46.297887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.299457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.306053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.306403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.306696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.306974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.307799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:46.308153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.309616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.310701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 311/609] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:46.318416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.338373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 299/610] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:46.344464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.524464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557058-02ac-4525-b199-62f64988fedd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.549494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcd7be-3236-40ee-ade6-314e937f7551 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.579374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.589707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.590804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.591247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.591668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.605107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.606983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.617093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ce9a-fbb4-4a2a-88b1-e9af064cbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.619490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ce9a-fbb4-4a2a-88b1-e9af064cbf46 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.620087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ce9a-fbb4-4a2a-88b1-e9af064cbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.620797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ce9a-fbb4-4a2a-88b1-e9af064cbf46 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/b58dcd8f33cb40fc9580af1fa294e369/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.625309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-afe10972-9491-4a64-b1d3-4eecf151c815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:46.628196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:46.630225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:46.631233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:46.631233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:46.631233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:46.631233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:46.631233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 312/611] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:46.631233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203072b-2198-47b7-b37e-6126920ebaa0 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.631584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203072b-2198-47b7-b37e-6126920ebaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.632871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203072b-2198-47b7-b37e-6126920ebaa0 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.643463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 313/612] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:46 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:46.643463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203072b-2198-47b7-b37e-6126920ebaa0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.651618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530ce9a-fbb4-4a2a-88b1-e9af064cbf46 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=b58dcd8f33cb40fc9580af1fa294e369, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.653388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530ce9a-fbb4-4a2a-88b1-e9af064cbf46 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.671230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 300/613] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:46 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/b58dcd8f33cb40fc9580af1fa294e369/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:46.673525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.673973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.674691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.698654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:46.700412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:46.854927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 301/614] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:46.869258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203072b-2198-47b7-b37e-6126920ebaa0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.883668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.914771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.915719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.916116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.916497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.917410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:46.917831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.919369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.935286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 314/615] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:46.941028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.991861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.054279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d0639-8050-46ee-a9bc-e1acbbe4d632 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.081517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d474a-99fc-4269-90f7-21bb1fdc55a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.102988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.103808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.103928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.104123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.104808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.117673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.119170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.126873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.127741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.128025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.128303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:47.144445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:47.145670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:47.146859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 315/616] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:47.151268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:47.151824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:47.167358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:47.168510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:47.169523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 302/617] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:47.175543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.259115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.263449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ec696-cd86-41e0-aac9-e102c90c59d6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.309767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.310467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.310753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.311031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.311985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:47.312542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.314856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.335524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 316/618] 10.222.0.113 () {56 vars in 1140 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:47.341309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.425777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43a3ba-d7a2-4f1b-863c-d9c6bfe4768d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.475477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a4dbc-f5af-4be2-9128-e391fdbf1f5e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.517150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.517150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.517150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.517150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.525877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.527382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.528317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.529771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.530553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.531335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.533040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:47.533669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.545172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:47.547402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:47.549794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:47.551431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:47.551431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:47.551431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:47.551431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:47.551431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 317/619] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:47.554518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.567858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.579715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 303/620] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:47.585419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.668432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e489ad-3ab4-4365-9d21-2f34d063c923 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.709829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.718011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.718717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.719005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.719286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.720039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:47.720351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.721809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.742204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 318/621] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:47.747760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.811571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc03d43-e47d-4a8d-b9cf-d9734042f400 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.895356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.912256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.918986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.919147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836657-65e2-4a51-92a6-f0813194fe29 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.919474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.919949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.955514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.956496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.957095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.957365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.957643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.957918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.974483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.975995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:47.986739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:47.987669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:47.988548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:47.988548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:47.988548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:47.988548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:47.993066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 304/622] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:47.999742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:48.005523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:48.006441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:48.007321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:48.008138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 319/623] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:48.015660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.179128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9015e2c-f5d5-40ed-8a22-e80219c6d88e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.212521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.216218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.222202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.223336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.223790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.224385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.225478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:48.225788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:48.227833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927dee4-1a0d-4b8e-9837-b636084362fc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.231852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5ea12-1bdc-4ffd-ac99-adf2dce0e530 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.244255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 320/624] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:48.249086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485243a7-47ee-465c-b12a-c4de1267516d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.249086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485243a7-47ee-465c-b12a-c4de1267516d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.249086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485243a7-47ee-465c-b12a-c4de1267516d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.249086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 321/625] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:48.254200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485243a7-47ee-465c-b12a-c4de1267516d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.291234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.292295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.292586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.292867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.293818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:48.294243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:48.295807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898648f-6af8-40cc-995f-a616d5cd2e05 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.313763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 305/626] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:48.315081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36f0cb-fea4-4401-a579-b08d3a718658 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.315367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36f0cb-fea4-4401-a579-b08d3a718658 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.315646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36f0cb-fea4-4401-a579-b08d3a718658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.335821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5c36f0cb-fea4-4401-a579-b08d3a718658 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:48.337807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c36f0cb-fea4-4401-a579-b08d3a718658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:48.402410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485243a7-47ee-465c-b12a-c4de1267516d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.433591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 306/627] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:48.436369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb25e0-a026-4e2b-8142-2fdfa0c71568 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.437152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb25e0-a026-4e2b-8142-2fdfa0c71568 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.437620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb25e0-a026-4e2b-8142-2fdfa0c71568 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.440142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 307/628] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:48.441057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb25e0-a026-4e2b-8142-2fdfa0c71568 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.463998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.464964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.465297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.465572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/d2e01af3550b4e638343e176888a21aa/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.484717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=d2e01af3550b4e638343e176888a21aa, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:48.486290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.511059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 322/629] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:48 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/d2e01af3550b4e638343e176888a21aa/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:48.511059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.562913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.580558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.600723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb25e0-a026-4e2b-8142-2fdfa0c71568 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.645049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.646205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.646660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.647033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.656790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:48.658374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.674528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3938d7-60c1-47b0-aeec-178eea9d8c8a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-52df5dd4-27c5-481c-b40a-2f8cbeae0a23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:48.684086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:48.685544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:48.686492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 308/630] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:48.687683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.687852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.690258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.710190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:48.711665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:48.725574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.728662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.728662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.728662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.744851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:48.754343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:48.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:48.756543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:48.760171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 323/631] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:48.761138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.807479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 309/632] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:48.814516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.895765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.901240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034bfda-ad20-4eb8-9837-780739ccbec1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.935678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.961460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.962436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.962894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.963317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.964785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:48.965290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:48.966935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.984642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2873a1-6607-4dcb-b4f6-9e95bf79ca4d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.992317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 324/633] 10.222.0.113 () {56 vars in 1142 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:48.993801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.032694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.032974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.033376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.033531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.034354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:49.034661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.036056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.045227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 310/634] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:49.051410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.127324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7405-b740-4037-9eb6-51fcf8378008 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.165039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.165857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.166137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.166408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.177432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:49.185538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e18404-8c0a-482c-bb69-82b929cd92b7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:49.186228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:49.187542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 325/635] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:49.188583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.218191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.232605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.239830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.240601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.240965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.241734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.322787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63712-5983-492f-ad8f-15baaf910755 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.328837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.330817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.360200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.361001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.361303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.361569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.373445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.374938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5889bf06-b52e-46bb-b7dc-29771266985b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:49.392998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:49.394543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 326/636] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5352e6-e586-41c3-b4e3-db34b34c974b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.395998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5352e6-e586-41c3-b4e3-db34b34c974b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.396638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5352e6-e586-41c3-b4e3-db34b34c974b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.401853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 327/637] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:49 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:49.402641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5352e6-e586-41c3-b4e3-db34b34c974b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.459195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 311/638] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:49.462250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.489427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.498262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.534548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5352e6-e586-41c3-b4e3-db34b34c974b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.573999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.574675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.574958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.575230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.576008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:49.576315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.577910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87036c2a-e30b-4309-b12d-888df2bdcc8a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.584772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f46f9-94ae-4c4f-9101-c3bbe5915949 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.589204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 328/639] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:49.591283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.591752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.592133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.620875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:49.622127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:49.642455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.643404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.643819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.644099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.645457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:49.645983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.648327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.667157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 312/640] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:49.667157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.713727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 329/641] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:49.714825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.796948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.802661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.812957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a23f-ce78-4d62-8e68-a4a848e10944 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.844804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572c970-d2b4-48df-ad8b-47db31c2f7ba None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.852802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.854592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.855099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.855900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.878085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.879545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.888311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.889136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.889790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.889790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:49.900357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:49.901527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:49.902945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:49.902945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:49.902945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:49.902945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:49.903636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.905164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.906361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 313/642] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:49.908763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:49.929410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:49.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:49.931692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:49.931692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:49.931692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:49.931692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:49.931692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 330/643] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:49.931692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.030107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79239d-b093-470f-8b61-5388a02c99c9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.058764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d27b2-50ba-4ee7-9c42-d29b3a3bc846 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.069436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.071034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.071468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.071904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.075017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.081633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.083116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:50.098751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.099760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 314/644] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.100766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.106874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.115241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.116042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.116321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.116591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.127697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:50.136339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.137569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:50.138594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:50.145673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 331/645] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.145673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.240612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc7f20-8d42-43b2-a46a-0d9d3ac5db6c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.260759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363289d0-9f92-4707-935f-d29e9c87e2c0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.277665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.278347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.278614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.278890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.279622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:50.279926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.281782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.295558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 315/646] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:50.296416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.308364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.309394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.309685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.309964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.310703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:50.311009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.312567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.331047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 332/647] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:50.332018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.368571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.371085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.415143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80d019-b072-4b11-8d98-04b937ad8d99 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.445197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba3c25-6439-4cee-a02a-c10512fde25c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.451594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.452278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.452564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.452845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.453859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:50.454169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.455616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.476463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 316/648] 10.222.0.113 () {56 vars in 1142 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:50.477503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.487048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.487726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.488009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.488281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.491833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:50.491833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.491833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.509917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 333/649] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:50.509917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.609140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655647f-d45f-4bd1-ac70-7e9e5b59a8ce None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.621273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.630893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9f800-b338-4901-b8b7-a6c52967458e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.635631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.648157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.649370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.649595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.649811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.656973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.658472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.667720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.668526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.668805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.669079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:50.673031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.674722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 317/650] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.676677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.685512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.687654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:50.702665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.703876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 334/651] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.704962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.791312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc0a2d-0194-4982-9e44-456789669a88 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.811273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361487f1-c48f-42d4-922d-88748af5d2ef None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.828070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.828730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.829012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.829334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.848919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.849714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.849993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.850266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.862473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.863921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-788c450e-10d1-4fe7-bce1-06ab9c3e26c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:50.881628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.882711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.884164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:50.884164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:50.884164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:50.884164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:50.884164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 335/652] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.884556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.884658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab16b5-ce52-4ce3-833e-a7c9ae1f8ce3 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.884658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab16b5-ce52-4ce3-833e-a7c9ae1f8ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.884896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab16b5-ce52-4ce3-833e-a7c9ae1f8ce3 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.886377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 336/653] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:50.887076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab16b5-ce52-4ce3-833e-a7c9ae1f8ce3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.900518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.909659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.911099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.002876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab16b5-ce52-4ce3-833e-a7c9ae1f8ce3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.015102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 318/654] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:51.015946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.041485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.042152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.042434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.042710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.043493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.043802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.045290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.057939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 337/655] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.059212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.098901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.120078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f31846-eabc-453f-bdfd-5f6b5de4e526 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.130714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.155506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.156189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.156471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.156745 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.157627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.157933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.159375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261239-6292-46dc-b5cf-c7017d2b004c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.167026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599c5d-4554-42f1-9cad-07296f6c1393 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.178076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 319/656] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.179373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67124283-d456-455f-916a-95e76991f756 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.179716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67124283-d456-455f-916a-95e76991f756 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.180660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67124283-d456-455f-916a-95e76991f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.198580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-67124283-d456-455f-916a-95e76991f756 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:51.199803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-67124283-d456-455f-916a-95e76991f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:51.203061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.203734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.204011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.204282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.204995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.205325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.206707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.218577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 338/657] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.219394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.270390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 320/658] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:51.271368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67124283-d456-455f-916a-95e76991f756 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.322897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593257f-7890-4860-a91d-6a18f92e2ea4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.350910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.360350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.361186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.361467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.361738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.364057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.375614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.377020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:51.395322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:51.396258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:51.397569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:51.397569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:51.397569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:51.397569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:51.397875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67124283-d456-455f-916a-95e76991f756 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.397963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 339/659] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:51.398240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.433781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.434435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.434714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.434977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.435809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=59220145172c436b8995414a68d94bfd) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.436114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.437586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.443466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 321/660] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/role_assignments?user.id=59220145172c436b8995414a68d94bfd&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.444244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.512002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e30c-6f15-41b8-90e6-735e07b53b7a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.553730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.554409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.554743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.555029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.565551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e198f-e6ca-439e-af5e-42b07d2f9b64 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.606238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.608002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.608002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.608347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.611584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.615157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.619993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.621506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:51.637701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:51.638701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 322/661] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:51.639660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.645683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.647499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.763420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40a58b-ff76-4f56-a4b0-fdf80791b29d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.770950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 340/662] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:51.770950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.803251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.804058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.804335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.804673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.816377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:51.826911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:51.828041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 323/663] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:51.828983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.863787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.886135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04209232-ab88-4e5f-812a-6c231ab16fbb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.904283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.926145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.926829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.927113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.927392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.928125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.928434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.929961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.942759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 341/664] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.943610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.964542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8277c-3c55-4c0c-8953-548b96bf94cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.009509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.010409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.010620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.010898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.011756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:52.012124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.013638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.035216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 324/665] 10.222.0.113 () {56 vars in 1144 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.036074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.061893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328fad9-3ac0-4781-a906-ebeea665cdfa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.098571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.099375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.099652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.099925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.110679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.116296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.117946 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:52.142668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.143622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.144509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:52.144509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:52.144509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:52.144509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:52.148523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 342/666] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.149489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.158009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f38c48-03f8-4315-a465-ad618bc83cf8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.172811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.200657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.201361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.201644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.201917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.202674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:52.202979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.204400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.213865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 325/667] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.214704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.270786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77afbb2-71c0-450c-babb-09f5a19b4d0b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.311191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.311988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.312266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.312549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.319476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.321032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.323498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82360-6b13-4905-99cd-01e3b1aea7d7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:52.335618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.337550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 343/668] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.338444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.369259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.369926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.370218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.370481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.395484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.425737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.443939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341455-5868-4e0e-901b-70b89257a5b6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.454851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.456407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.481499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.482263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.482554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.482827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.483548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:52.483852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.485265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.498133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 344/669] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.498747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.583134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 326/670] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:52.583826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.627708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e4a0a-8bf8-4166-acb6-9eb19ad57f67 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.642887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.663638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.669472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.670291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.670576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.670861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.682631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.684037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.691832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f3382-c6b9-4f58-ab35-0490b60ac757 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:52.704070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.705314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.706472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:52.706472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:52.706472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:52.706472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:52.706472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 345/671] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.706820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.735832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.736507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.736795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.737342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.737899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:52.738299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.739650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.759396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 327/672] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.759396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.853825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca80de3-a877-4c7e-8382-829e614bf56e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.907906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.909181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.909636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.910094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.921697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.923337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4911f0-dc04-4b53-b81c-80d65973f48e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.924181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:52.948400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.949562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:52.950964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:52.954238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 346/673] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.955103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.975398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.976183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.976618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.977223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.980113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.985234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.993652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.995149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:53.014873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:53.015868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:53.016772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:53.016772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:53.016772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:53.016772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:53.020621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 328/674] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:53.021503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.079653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d752a6-c67c-40cc-bd45-cfb36b79ab8e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.120638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.121553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.121933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.122305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.123145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.123550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.124974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.136727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590936d-2fbc-4825-8920-990e5e61d867 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.137766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 347/675] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.138619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.181043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.182050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.182866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.183270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.184961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=e0573ae51c744a45aeca013357431eb0) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.185470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.187380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.205244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 329/676] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/role_assignments?user.id=e0573ae51c744a45aeca013357431eb0&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.205244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.232505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.252598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb64fd-2de4-4cdb-bbd5-3b8a5aa5fd5c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.277552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.295981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.296789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.297164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.297448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.298257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.298571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.300087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.315418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 348/677] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.316675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.352795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b085c-3ca2-49cd-84f9-092ae40534e1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.400011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.400963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.401436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.401778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.402527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.403378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.404397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.419665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 330/678] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.420540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.457074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16f977-3842-48ca-9b19-dbb23ba52f4f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.501787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.502587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.502871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.503141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.512702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.513919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:53.535311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:53.536327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:53.537334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 349/679] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:53.537942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.544021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.556238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f69e6-3623-40d4-8295-3aa0c0025e4a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.572080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.602557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.603422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.603757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.604090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.605214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=15cfb6d527464ccaad7db841e3eacf7c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.605628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.607085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170ecd-979e-43d5-a448-87e46ca650d7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.620286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 331/680] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/role_assignments?user.id=15cfb6d527464ccaad7db841e3eacf7c&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.620286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630f389-1127-43d1-b611-4160f75799ba None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.620286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630f389-1127-43d1-b611-4160f75799ba None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.620286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630f389-1127-43d1-b611-4160f75799ba None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.623506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 332/681] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:53 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:53.625213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630f389-1127-43d1-b611-4160f75799ba None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.654218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7021bca-8fb8-48b3-a236-3b7cea4cd7d1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.697419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.698413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.698758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.699120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.707496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.709086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-41297a71-f09d-4939-858a-8b4793961796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:53.724929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:53.725972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:53.727049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:53.731930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 350/682] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:53.733513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.733867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.734212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.759143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:53.761107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:53.769265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630f389-1127-43d1-b611-4160f75799ba None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.815650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.816344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.816625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.816903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.817873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.818183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.819638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.841680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 333/683] 10.222.0.113 () {56 vars in 1140 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.842556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.847339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.860090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 351/684] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:53.861060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.890588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.001084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11b0b-f825-4613-a3f1-a8654c3ef8a3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.009159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857a010-2c80-4bc9-9ac6-15e05d9b55a5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.049012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.049989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.050287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.051048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.052166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:54.052575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.054085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.056345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.057204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.057588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.057953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.069760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 334/685] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:54.070763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.137021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.146760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.148300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.173293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.183141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edc02-5683-4ad6-ba63-fc347755c7ea None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.219058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.220377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.220809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.221197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.222221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.224688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:54.243102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:54.244353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:05:54.245442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:54.252235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 335/686] 10.222.0.113 () {56 vars in 1134 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:54.252235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.276181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 352/687] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:54.277423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.364167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad005bc-56c5-4f34-9522-7d130f24c01f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.405632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.406300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.406580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.406854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.407137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.407686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=b58dcd8f33cb40fc9580af1fa294e369) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:54.407999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.409776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.415920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e3b0-cfdc-4127-8f3f-d9e4c18714cb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.416526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 336/688] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/role_assignments?user.id=b58dcd8f33cb40fc9580af1fa294e369&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:54.417597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.441503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.504997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.505718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.505983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.506260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.506995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:54.507303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.513698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.524198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 353/689] 10.222.0.113 () {56 vars in 1129 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:54.528655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.604606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272155b-c614-4d47-b746-7671d96a0200 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.681631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.682440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.682715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.682985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.696975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.699087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.714346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d2970-8641-43bd-bc78-a7573799d0c9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:54.722642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:54.724716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:54.726882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:54.726882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:54.726882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:54.726882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:54.726882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 337/690] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:54.735012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.756996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.758085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.758367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.758643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.759361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:54.759722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.761523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.768779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 354/691] 10.222.0.113 () {56 vars in 1129 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:54.823105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.862951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2738-d111-4ae5-a11c-6acf76aadb6c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.903581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.904523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.904971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.905406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.906398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:54.906864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.908414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.923972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 338/692] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:54.930555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.969169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:55.067887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc82d-21f3-4477-bb95-99c08b5cc9e9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.121049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.121885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.122161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.122484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.138981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.140591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:55.162024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:55.162998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:55.163987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 355/693] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:55.169163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:55.435241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ab730-ea84-420a-ab1b-3f2cbbf3ca22 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.467623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:55.472889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.473592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.473876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.474152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.474956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:55.475261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.476768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11a6ed-6737-48db-996d-bda2b2e3746a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.490133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 339/694] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:55.496778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:55.559856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b548e08-15f1-4cdd-8c3d-74004bf4c12d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.560447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b548e08-15f1-4cdd-8c3d-74004bf4c12d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.560811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b548e08-15f1-4cdd-8c3d-74004bf4c12d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.563270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 340/695] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:55.573370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.573730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.574535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.595977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:55.597217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:55.644523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:55.673173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166dac0-1a61-4b6b-accb-7fd1f3d895d7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.723691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.724373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.724662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.724944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.725850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=d2e01af3550b4e638343e176888a21aa) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:55.726172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.727845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.735087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 356/696] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:55 2022] GET /identity/v3/role_assignments?user.id=d2e01af3550b4e638343e176888a21aa&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:55.767752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 341/697] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:55.800228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:55.917608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f77b-ba67-47be-9ebc-ed4b9ee3fef3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.966619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.967450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.967735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.968019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.990307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.992250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:56.002955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-19e8e343-d8ab-4fb7-bb6d-3a8f847e46aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:56.017224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:56.018165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:56.019049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:56.019049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:56.019049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:56.019049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:56.022011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 357/698] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:56.029188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:56.121165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1242be-f326-4e73-9631-f73cd4d25df9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.121831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1242be-f326-4e73-9631-f73cd4d25df9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.122283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1242be-f326-4e73-9631-f73cd4d25df9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.124307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 358/699] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:56.130779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.131384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.131729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.153946 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:56.155520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:56.190931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fb9d-4f34-4093-b210-03a80d78d0c7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:56.222389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:56.245361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:56.246485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.247204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.247663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.249272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:56.249772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:56.251362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:56.253037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 359/700] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:56.274692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 342/701] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:56.280466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:56.293771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:56.484018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126332-f8af-4b90-8a57-f39bc73c7c17 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:56.489780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a15f2-5e47-436b-a10f-ab5de2c421f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:56.531108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:56.541246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:56.541986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.542335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.542709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.543575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:56.545380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:56.561889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:56.562824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.563109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.563710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.572828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 360/702] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:56 2022] POST /identity/v3/users => generated 255 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:56.587491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:56.599926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:56.601541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:56.602561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 343/703] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:56.609743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:56.751617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fbdf0-f3c2-4dd0-9cad-55a70938f918 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:56.793952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:56.794950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.795385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.795848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.796824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:56.797325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:56.798944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:56.810431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 361/704] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:56.816868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:56.890320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:56.958935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51abff3-44f4-4caa-bef3-52efd72cbd76 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.037449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.038491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.039011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.040389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.062347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.063822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-09bf17a8-a353-43b6-968c-03e6e5f6dac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:57.086385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:57.087552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:57.088460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:57.088460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:57.088460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:57.088460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:57.089157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 344/705] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:57.095044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.151931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.217254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63703625-e433-4ca4-bb5a-a4e4437a90ce None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.256717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392b594-af26-4261-a635-60978931fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.258094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392b594-af26-4261-a635-60978931fe96 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.258620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392b594-af26-4261-a635-60978931fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.259123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392b594-af26-4261-a635-60978931fe96 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.259315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de650b-338b-445d-afd8-8dff08836ed8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.259607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de650b-338b-445d-afd8-8dff08836ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.259883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de650b-338b-445d-afd8-8dff08836ed8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.260706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392b594-af26-4261-a635-60978931fe96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:57.261409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392b594-af26-4261-a635-60978931fe96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.261808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 345/706] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:57.263592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392b594-af26-4261-a635-60978931fe96 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.267400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3d30f-c6bf-4d06-8c06-ba7fffe06752 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.267704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3d30f-c6bf-4d06-8c06-ba7fffe06752 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.267951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3d30f-c6bf-4d06-8c06-ba7fffe06752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.281007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 362/707] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:57.286841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392b594-af26-4261-a635-60978931fe96 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.326375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-93f3d30f-c6bf-4d06-8c06-ba7fffe06752 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:57.327518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-93f3d30f-c6bf-4d06-8c06-ba7fffe06752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:57.400576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392b594-af26-4261-a635-60978931fe96 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.409883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.444860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.445928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.446214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.446492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.456107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.457722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.463345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 346/708] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:57.465539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cc287-a03f-45d8-8ee5-148644d88755 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.466047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cc287-a03f-45d8-8ee5-148644d88755 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.466574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cc287-a03f-45d8-8ee5-148644d88755 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.472962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 347/709] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:57.475154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:05:57.475430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:57.476399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:57.478905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 363/710] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:57.479576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.479576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.483499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.504598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:57.505943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:57.526998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.609694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 348/711] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:57.610512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.634251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7fe1c-2848-46db-b1d3-a5f1a8c1fabc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.682360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.683327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.683674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.684019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.684943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:57.685337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.686884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.708485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 364/712] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:57.709647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.740446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.748844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6720d2-2ff5-4851-acbe-746f7b76cf43 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.793414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.794236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.794613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.795007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] PATH_INFO: `/v3/services/network` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.795450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.797034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:57.811576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:57.812664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:57.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 349/713] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:57.814980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.839859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.852864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5419a1-85a8-45df-89af-c6f853b8c659 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.903387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.903990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.904272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.904548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.905311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.906724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.937147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 365/714] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:05:57 2022] POST /identity/v3/services => generated 252 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:57.937147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.965478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9374d-3409-4b21-a08c-59a44b8ac985 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.059831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.060521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.060805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.061083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.132073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.158949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444734d-3879-44c0-a8fd-296ecac74c04 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.212701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.213720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.214335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.214888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.215385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.215869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.216780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] RBAC: Adding query filter params (name=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:58.217426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.219024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.225361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 366/715] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/services?name=network => generated 125 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:58.238505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.240082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.355086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 350/716] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:58.366764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.405692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41e90-809d-4560-a226-da71fc26f3aa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.501987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.502772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.503157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.503534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.504373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:58.504773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.506322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.508710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8496a5-b5fb-4954-a43b-79f319075d08 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.520148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 367/717] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/services?type=network => generated 125 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:58.541535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.561950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.563019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.563443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.563857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.582539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.585467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5c6a5796-4261-4348-b021-aa34ccd80036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:58.617369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:58.619016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:58.620635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:58.620635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:58.620635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:58.620635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:58.623742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 351/718] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:58.631141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.647701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317ed3-0cc6-4c7c-8c87-51402eb1e25d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.648559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317ed3-0cc6-4c7c-8c87-51402eb1e25d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.649000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72317ed3-0cc6-4c7c-8c87-51402eb1e25d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.651063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 352/719] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:58 2022] GET /identity => generated 271 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:58.669059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.669688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.670041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.670729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.705104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:58.706614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:58.824317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3941-8bb3-4993-ab0b-ba35f80e4df9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.837255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 353/720] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:58 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:58.857018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.873497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.874844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.875424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.875843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.878558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:58.879049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.882089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.911076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 368/721] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:58.922391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.027322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.062535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcec1bb-c50c-45eb-ad9a-ffba85b39ebf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.102213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.104087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.104741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.105883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.117794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.119925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.130262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:05:59.138425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:59.139393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:05:59.140334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:59.142969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 369/722] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:59.147483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ad49-d146-4fc1-b897-df2d519dfb9b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.148716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.223701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.224896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.225997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.226553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.239159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:59.248799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:59.250662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:59.251527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:59.260473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 354/723] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:59.263887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.418656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae96a3-1532-4cc2-b10d-be5c735fa74e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.466959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1844d74-f116-49ea-864a-fec09c3372c1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.474597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.482288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.484164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.484687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.485187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.486185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:59.487201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.489572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6ad90-7db0-4c8e-b7f8-56134441d4fe None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.510253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 370/724] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:59.512488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cbdc-1f30-44ac-b214-125f55d18703 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.513253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cbdc-1f30-44ac-b214-125f55d18703 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.514181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cbdc-1f30-44ac-b214-125f55d18703 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.516046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 371/725] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:05:59 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:59.517046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306cbdc-1f30-44ac-b214-125f55d18703 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.525400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.526092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.526373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.526647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.527414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:59.527720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.529106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672beb46-3ca9-44b7-84c6-2dbf939850f4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.541205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 355/726] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:59.543180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.545441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.546863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.574085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:59.575372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:59.601969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.666886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306cbdc-1f30-44ac-b214-125f55d18703 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.685247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 356/727] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:59 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:59.687297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.735121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.735829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.736125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.736520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.737870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=15cfb6d527464ccaad7db841e3eacf7c) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:59.737870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.739138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.746052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 372/728] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/role_assignments?user.id=15cfb6d527464ccaad7db841e3eacf7c&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:59.747309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.817709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.833790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0b85a-4067-453c-9467-15c87708eaa1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.871360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7cf1-d8bd-4f8a-8bea-7fe677409242 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.884593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.886187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.886671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.887140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.899664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.901660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.910797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.911830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.912123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.912405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.914816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:59.926381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:59.927329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:59.928236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:59.928236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:59.928236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:59.928236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:05:59.928458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:59.931164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 357/729] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:59.940419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:59.941525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:05:59.942373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 373/730] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:59.944369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.944938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.074257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fdef9-4dd7-47a6-816e-5f09ebe9ec7d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.093019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:00.096628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4206bd-ad72-4c0a-b42d-12a33888667f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.115108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.116125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.116491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.116863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.117876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:00.118297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.120018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.131977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 374/731] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:00.137852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.141292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.142234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.142691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.143142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.144155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:00.144638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.146286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.159900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 358/732] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:00.168712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.240298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:00.268605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554381e7-d645-4d88-bbd7-6d664170d67e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.308296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.309260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.309546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.309823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.323073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.324733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:00.345053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:00.346104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:00.347017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:00.347017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:00.347017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:00.347017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:00.347017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 375/733] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:00.352222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.359413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab8b3-c8b1-43b6-af72-dc2d1e7b5aff None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.392573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:00.468711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b2f96-0b28-4d63-9ba5-736dd62bdff7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.473892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.474726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.475006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.475289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.494158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.495818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.506848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.508272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.508390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.508688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.509480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:00.509789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.511282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.524902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 376/734] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:00.530346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:00.531115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:00.532036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:06:00.532981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:00.541663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 359/735] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:00.547073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.637583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:00.645554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea66c0-a445-41c3-887f-24a230088d0f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.683690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.684536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.684818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.685089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.693857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.695754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8d517685-ac63-4c9d-b62d-55cffd571271 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:00.711722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:00.712737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:00.713692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:00.717768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 377/736] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:00.719310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf4a2-b9c3-42e3-b135-3ac7132ea09a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.719603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf4a2-b9c3-42e3-b135-3ac7132ea09a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.719878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf4a2-b9c3-42e3-b135-3ac7132ea09a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.721505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 378/737] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:00.722238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf4a2-b9c3-42e3-b135-3ac7132ea09a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.732249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57987-0513-456c-9958-53a454c0922b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.756161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:00.774222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.775163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.775601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.776052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.777204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:00.777661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.779346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb71ab-56cf-4523-b27b-bc70f0be7b59 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.804805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 360/738] 10.222.0.113 () {56 vars in 1140 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:00.806819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.807271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.807698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.827638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:00.829276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:00.843443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf4a2-b9c3-42e3-b135-3ac7132ea09a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.880647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:00.881415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.881748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.882025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.882938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:00.883327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:00.884906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:00.909426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 379/739] 10.222.0.113 () {56 vars in 1154 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:00.910438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.923387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:00.948785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 361/740] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:00 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:00.950394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.024920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58864535-2ea4-49af-b7ba-f38f8e1b3354 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.065075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.065824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.066113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.066397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.093101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a643ff1-c3aa-4989-a841-8173769b4193 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.110958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.144344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984228-87b6-4768-93a4-8238bdf6b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.145368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984228-87b6-4768-93a4-8238bdf6b339 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.145847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984228-87b6-4768-93a4-8238bdf6b339 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.146264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984228-87b6-4768-93a4-8238bdf6b339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.161291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.163703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.179894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.242269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984228-87b6-4768-93a4-8238bdf6b339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.247115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984228-87b6-4768-93a4-8238bdf6b339 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.286082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 380/741] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:01.287303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.405630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 362/742] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:01.407129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa88c5-ebee-48ae-91be-59e962fb8ff9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.407425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa88c5-ebee-48ae-91be-59e962fb8ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.407711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa88c5-ebee-48ae-91be-59e962fb8ff9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.413306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 363/743] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:01.413306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa88c5-ebee-48ae-91be-59e962fb8ff9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.422799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.428654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec5829-8989-4ab8-a8fb-fdb07dae9bae None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.440763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.482820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.483823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.484517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.484740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.485471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.486890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:01.506236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:01.507684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:01.508920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 381/744] 10.222.0.113 () {56 vars in 1134 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:01.510768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.568505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa88c5-ebee-48ae-91be-59e962fb8ff9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.606209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.607183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.607388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.607683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.619961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.621474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7d17b09c-6e6b-4d05-8197-e15f233d0db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:01.644738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:01.645970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:01.647053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:01.647053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:01.647053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:01.647053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:01.647286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe594de-387f-4f3f-9dc2-a0b5211a2845 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.650689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 364/745] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:01.652130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.652429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.652707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.673019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:01.674284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:01.690159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.690975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.691258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.691535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.704655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.706186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:01.727518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:01.728639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:01.734621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:01.734621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:01.734621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:01.734621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:01.734621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 382/746] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:01.734621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.750769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.771227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.774092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 365/747] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:01 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:01.775846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.874333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c2867-f3f2-44cb-903e-6f3d97851794 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.920676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b018ce-2806-4430-baed-4d28924d44d6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.928609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.930408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.930862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.931281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.932149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:01.932601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.934186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.939311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 383/748] 10.222.0.113 () {56 vars in 1129 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:01.940365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.965666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.966935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.967401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.967827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.968707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:01.969177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.970701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.984506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 366/749] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:01.985624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.064170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.076579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.082736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5804c-7e41-4273-af4b-9a31d8a7de85 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.124300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.125037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.125320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.125557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.126289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:02.126592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.128008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.133211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f541c-a6a6-4d0d-bac8-525ab9456345 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.147210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 384/750] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.147210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.179479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.180329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.180769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.181053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.181835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.183235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.201164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 367/751] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:01 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:02.202655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.282021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652992d-4757-4808-857a-2e86280db1b6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.342522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.343514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.343920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.344264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.345839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:02.346225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.348108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.357281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 385/752] 10.222.0.113 () {56 vars in 1129 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.358548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.377504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.383871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7a420-4aaf-4145-8a49-be631358924f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.403092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.431249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.432075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.432357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.432634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.440185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.441709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:02.459200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:02.460162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 368/753] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:02.461807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.503602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ca0f-d924-47fd-8c5b-a03799e8d759 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.543899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.544725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.545009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.545309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.553332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.555865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-430eb28d-c237-4b80-b498-c32e519f1130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:02.572852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:02.574766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 386/754] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67716f5-4e26-49eb-b20a-eae6b6db303e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.576480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67716f5-4e26-49eb-b20a-eae6b6db303e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.579439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67716f5-4e26-49eb-b20a-eae6b6db303e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.582880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 387/755] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:02 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:02.582880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67716f5-4e26-49eb-b20a-eae6b6db303e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.625293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44dfaf-769a-4db8-a513-93e0e7e92010 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.674135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.674962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.675072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.675358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.676931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.677055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] RBAC: Adding query filter params (interface=public, service_id=a760b1ecfc3e43bb9f85b7e391f6a29d, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:02.677168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.679342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.697512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 369/756] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/endpoints?service_id=a760b1ecfc3e43bb9f85b7e391f6a29d&interface=public®ion_id=RegionOne => generated 195 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.699165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.731171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67716f5-4e26-49eb-b20a-eae6b6db303e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.746203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.801193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.802185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.802609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.803061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.803847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:02.804189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.805695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c6566-4cd3-400e-92e9-2d47ddcc63cb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.823953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 388/757] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.823953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.823953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.823953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.843646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:02.844869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:02.861650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ffb23-e2f9-444a-b666-4e33f07a6233 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.927638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.928620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.929016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.929529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.930863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:02.931329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.933854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.953421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 389/758] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:02 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:02.953421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.972726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 370/759] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.973769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.043029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.139827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fc56e-fc62-4107-99ac-c4836cf3064f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.142886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.152188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25153b9-d6eb-49ff-beee-37edf7c1b3c6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.188934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.189558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.189836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.190169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.190802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.191371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.192040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.192218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.192315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.192599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.193595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=d2e01af3550b4e638343e176888a21aa) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:03.194023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.196064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.205671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 390/760] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/services => generated 776 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.207322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.211869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 371/761] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/role_assignments?user.id=d2e01af3550b4e638343e176888a21aa&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.213829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.407071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601abf-750d-44d0-bb74-74a94dd05da2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.454525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.468035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fa9ff-2f72-404a-ae44-33cd7d1b5d84 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.471125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.472141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.472491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.472865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.493147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:03.496062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:03.497275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:03.498326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:03.505438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 391/762] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:03.506933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.532041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.532980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.533459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.533886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.534904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=8f175454d9b245fc88b69aa73568b5d4) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:03.535223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.536824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.553784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 372/763] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/role_assignments?user.id=8f175454d9b245fc88b69aa73568b5d4&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.660803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5ba2-f54f-4a9d-9adc-88ace08429a4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.712448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.713556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.714049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.714523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.715505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:03.716052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.717760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.734208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 392/764] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:03.740407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.770103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.855863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764cd6-587f-41a1-8ff2-121646048b8a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.892961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.893801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.894082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.894353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.906574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.908040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:03.926560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:03.927516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:03.928411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:03.928411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:03.928411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:03.928411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:03.933316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 373/765] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:03.934787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.010064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.101997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b7458-8056-4dcc-93ba-dc3457b94ff7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.152789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.153770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.154232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.154657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.155538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:04.155993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.157580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.172426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 393/766] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:04.181454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.350660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.404127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5902-a7d0-4d57-8fc3-c5cce6101c38 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.471819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.472643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.472930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.473235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.494512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.496009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:04.515906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:04.516957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:04.517948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 374/767] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:04.524016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.741045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5768d-7b75-463f-9b1f-4682bb41c8da None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.755605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.819217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.819976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.820260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.820687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.821585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:04.821895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.823401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bc63a-3f09-4d08-9622-b493840ab07d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.853504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 394/768] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:04.862252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.915647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd669-1bf9-4bf8-903e-50297d1bf1c2 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.915950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd669-1bf9-4bf8-903e-50297d1bf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.916203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fd669-1bf9-4bf8-903e-50297d1bf1c2 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.917976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 395/769] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:04.923225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.923509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.923787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.958341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:04.959574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:05.049840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654528cb-158e-4a10-8bbb-15a3065ee44c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.106546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.107365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.107652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.107932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.115091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 396/770] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:04 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:05.121475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.130876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.132485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.141524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:05.157055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:05.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:05.158951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:05.158951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:05.158951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:05.158951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:05.158951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 375/771] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:05.169876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.401227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.419302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14245c-3802-4362-b6b1-ff3414edac7f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.456678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bf99-00c6-47d6-b642-ee05c89b0725 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.472423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.474283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.474727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.475267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] PATH_INFO: `/v3/services/network` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.476263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.478033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:05.498249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:05.499508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:06:05.500538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:05.503723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 397/772] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/services/network => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:05.513436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.545946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.546635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.546971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.547256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.548008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:05.548317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.549771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.564897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 376/773] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:05.571168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.674069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.748963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995381-1a7e-4d6d-a954-187445a951f5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.766079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00758b6-2029-4050-b500-61f93620c208 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.788043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.789416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.789979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.790516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.799099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.800939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0100964e-266d-4c2d-9fa0-d55eb414d2af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:05.822451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:05.824110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:05.826533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:05.832547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 377/774] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:05.832547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd35b3-7c02-45d4-839c-55530e18556e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.832547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd35b3-7c02-45d4-839c-55530e18556e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.832547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd35b3-7c02-45d4-839c-55530e18556e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.837437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 378/775] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:05.840879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.840879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.840879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.840879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.841696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] RBAC: Adding query filter params (name=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:05.841696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.842742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.847021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.847021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.847021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.856525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 398/776] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/services?name=network => generated 125 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:05.857840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.877069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:05.878389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:05.891239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.993506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 379/777] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:05 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:05.994515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.018853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92064bcd-e224-4bbe-9c3d-196fc0ad8970 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.065921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.084666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.086018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.086521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.086921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.088438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:06.088780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.090588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.115897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 399/778] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.117077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.158386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba6581-f805-4882-8160-2f5eb880ca87 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.208002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.208694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.208967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.209270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.210001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] RBAC: Adding query filter params (type=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:06.210435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.212282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dbc56-8e75-4522-80b1-bf6e5ab1863d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.219041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 380/779] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/services?type=network => generated 352 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.220442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb52ef-d574-4036-a4c3-6eda3445e0ee None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.220730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb52ef-d574-4036-a4c3-6eda3445e0ee None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.221006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb52ef-d574-4036-a4c3-6eda3445e0ee None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.226874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 381/780] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:06.226874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb52ef-d574-4036-a4c3-6eda3445e0ee None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.235783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.258877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5440-0636-4c35-b1dc-df87725deb00 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.298075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.299045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.299475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.299879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.300728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.302541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:06.321920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:06.323768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:06.325437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 400/781] 10.222.0.113 () {56 vars in 1134 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:06.326505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.353244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.358383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb52ef-d574-4036-a4c3-6eda3445e0ee None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.410073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b2ff6-c85c-43a0-a42d-4ca67e86f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.411339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b2ff6-c85c-43a0-a42d-4ca67e86f20e None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.411623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b2ff6-c85c-43a0-a42d-4ca67e86f20e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.411935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b2ff6-c85c-43a0-a42d-4ca67e86f20e None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/15cfb6d527464ccaad7db841e3eacf7c/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.414374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b2ff6-c85c-43a0-a42d-4ca67e86f20e None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=15cfb6d527464ccaad7db841e3eacf7c, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.415844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b2ff6-c85c-43a0-a42d-4ca67e86f20e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.430514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 382/782] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:06 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/15cfb6d527464ccaad7db841e3eacf7c/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:06.431814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.432093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.432345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.455330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:06.456821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:06.475550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d906e-fd1a-4044-a57a-93be7492e381 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.517765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.518748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.519195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.519621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.520768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] RBAC: Adding query filter params (interface=public, service_id=ae341659a2c34f25aaa415a463604e83, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:06.521331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.523108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a1c3-176a-40e3-a9fd-fb330770cdc1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.533485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 401/783] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/endpoints?service_id=ae341659a2c34f25aaa415a463604e83&interface=public®ion_id=RegionOne => generated 195 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.535910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904162ce-b892-42ff-8307-1bae29e240c5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.536438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904162ce-b892-42ff-8307-1bae29e240c5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.537005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904162ce-b892-42ff-8307-1bae29e240c5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.539784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 402/784] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:06 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:06.540815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904162ce-b892-42ff-8307-1bae29e240c5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.546698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 383/785] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:06 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:06.547625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.560418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.665589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.682417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7e14-1eab-461b-a9b7-81762b5df7ea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.697898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904162ce-b892-42ff-8307-1bae29e240c5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.730798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64c10b-c6f0-41f3-8676-08e62d51e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.731465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c10b-c6f0-41f3-8676-08e62d51e511 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.731741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c10b-c6f0-41f3-8676-08e62d51e511 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.732032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c10b-c6f0-41f3-8676-08e62d51e511 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.732698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64c10b-c6f0-41f3-8676-08e62d51e511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.734134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64c10b-c6f0-41f3-8676-08e62d51e511 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.749497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 384/786] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/services => generated 776 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.749497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.749497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.749497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.753705 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.754532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.754882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.755312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.756144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:06.756582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.758714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.768742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:06.769647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 403/787] 10.222.0.113 () {56 vars in 1129 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.770690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:06.770818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.875881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.890520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 385/788] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:06 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:06.891692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.941335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc854-9578-44d7-b4d0-6b1648b2bf51 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.022130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.023592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.024305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.024878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.041523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.042458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:07.056711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:07.058497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:07.061104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 404/789] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:07.063031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.075473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a2ef5-e9b8-4f3d-baeb-f819d6356b7b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.118835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.119951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.120502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.120958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.121903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:07.122434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.124039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.130317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 386/790] 10.222.0.113 () {56 vars in 1129 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:07.131788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.199395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd975da-fe51-4f9f-a2ea-b6cc2c35fb36 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.235387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.242463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.243356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.243640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.244019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.255430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328e52-1b05-4213-b25d-5026179f9be4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.258977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:07.267080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:07.268046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:07.269342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 405/791] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:07.270280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.298341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.299624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.300281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.300822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.302190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:07.302740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.304419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.314323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 387/792] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:07.315626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.330048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.389235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf403c-c671-424b-81b4-041f6bed00dd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.428691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.429603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.430075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.430360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.431087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74e21e-b872-49a8-adfa-4f6cf4f3b564 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.431217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.432621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.461608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 406/793] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:07 2022] POST /identity/v3/endpoints => generated 348 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:07.462663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.484530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.485316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.485543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.485823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.486605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:07.486928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.488382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.517243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 388/794] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:07.524888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.613509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.664097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.722202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07c02-0507-4796-bf3b-f3981503481f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.751678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679af39-1a70-4040-9b4e-123ab1d21aa8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.790898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.791487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.792348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.792636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.792841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.792949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.793455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.793875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.806739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.809234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.809357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.811007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:07.831875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:07.832846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:07.833784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:07.833784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:07.833784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:07.833784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:07.836102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:07.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:07.838281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:07.838281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:07.838281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:07.838281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:07.838281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 407/795] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:07.839277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 389/796] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:07.845441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.845624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.952409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.955784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68604e3f-abae-49d4-a365-e2e94e8e4be3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.982575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33789c71-fd9a-4381-8d30-838f6ad36f94 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.001015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.001015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.001015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.001015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.001455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:08.001455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.001455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.013987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 408/797] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:08.019446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.022722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.060228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.060963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.061278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.061562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.062308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:08.062620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.064007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.095414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 390/798] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:08.101426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.212509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3634d-664f-4f94-aa5c-7f09902d2204 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.288096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0931f7-057f-4dd9-b642-815a25c14700 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.310079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.311177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.311458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.311767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.328056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.329673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:08.370321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:08.371354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:08.372312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 409/799] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:08.378922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.381927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.382999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.383095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.383363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.402375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.403937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:08.426862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:08.429381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:08.431758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 391/800] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:08.440160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.440559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.541590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.566034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3338045-0b07-40ce-b86c-3d1565a83952 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.610465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.611638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.612137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.612554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.613903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:08.614406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.616054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.638320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 410/801] 10.222.0.113 () {56 vars in 1154 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:08.644409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.769538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.774806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e08b28-5f70-4338-a6c7-25819e0fc21c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.792547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5df0bc-6251-4767-b801-83c5fa4b66d8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.859521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.860212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.860598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.860829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.862031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:08.862350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.864529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f3eb6-bad4-4c14-98e1-3ddebc9d9949 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.865411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.867021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.867710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.869560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.888043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.888246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 392/802] 10.222.0.113 () {56 vars in 1140 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:08.889785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee055fa7-ad9a-4bbd-8a9c-05be9df220c3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.890074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee055fa7-ad9a-4bbd-8a9c-05be9df220c3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.890351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee055fa7-ad9a-4bbd-8a9c-05be9df220c3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.890727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.896179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 393/803] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:08.896179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee055fa7-ad9a-4bbd-8a9c-05be9df220c3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-89c9d3e6-dae5-4a44-a90c-dcaadf1e9c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:08.916219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:08.917232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:08.918120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:08.918120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:08.918120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:08.918120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:08.918120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 411/804] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:08.919435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.919720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.919991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.939660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:08.940888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:09.012434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.018497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee055fa7-ad9a-4bbd-8a9c-05be9df220c3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.025142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 412/805] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:08 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:09.025142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.082735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.084013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.084516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.085006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.091917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.105333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.108150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.137655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf231-4f45-430b-87db-c8e2dfbc0149 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:09.143159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:09.144855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:09.146119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:09.146119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:09.146119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:09.146119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:09.147279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 394/806] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:09.148213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.179466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.180153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.180440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.185152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.185152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:09.185152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.185152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.197261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 413/807] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:09.198633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.288249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97440a8a-50a1-477f-8bad-22fbc5fc1321 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.327851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.328589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.328866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.329173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.344298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:09.347304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48aee-64af-4ec7-b60f-c4c10fb8f2ae None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:09.352564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:09.353561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 395/808] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:09.355326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.371497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.379296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.402062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.402740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.403023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.403333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.404026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:09.404339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.405768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f92f-cb11-4905-91cc-8aca0670239f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.422245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 414/809] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:09.427549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe791c-9f32-4071-b7ce-d3e6ce70aa55 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.427549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe791c-9f32-4071-b7ce-d3e6ce70aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.427549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe791c-9f32-4071-b7ce-d3e6ce70aa55 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.427549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 415/810] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:09.427549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe791c-9f32-4071-b7ce-d3e6ce70aa55 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.496762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1b6d7-ec83-4c61-8890-ccad0cb74040 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.545834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.547462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.547912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.548200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.557708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.559268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.565658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe791c-9f32-4071-b7ce-d3e6ce70aa55 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:09.576674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:09.577985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:09.579263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:09.585682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 396/811] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:09.589672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.626019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.626779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.627094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.627375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.628216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:09.628513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.630321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf54a5-ea52-4b80-8d20-9ed70204ec94 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.644720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 416/812] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:09.646911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.647261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.647661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.683609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:09.685084 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:09.713483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.735066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.756055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d042a9-f708-4736-b2a0-d2784d36f958 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.801143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 417/813] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:09 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:09.801143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.811349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.812247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.812878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.813201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.824322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.825884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:09.848508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:09.850249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 397/814] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:09.851633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.971248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6224-e37a-41c4-8fc2-a67f2c743ee1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.996236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9653-c019-4ef1-92ca-6303b6ffaa7e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.015595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.016314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.016543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.016812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.017708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:10.018014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.019470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.037694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 418/815] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.037694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.042849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.062872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.064121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.064545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.064980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.080058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.081619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.082886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:10.108463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:10.109755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:10.116520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:10.116520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:10.116520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:10.116520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:10.116520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 398/816] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:10.116520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.190344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9d4d-b355-42d6-8a0e-042be3e9caa5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.239375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.240618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.240904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.241259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] PATH_INFO: `/v3/services/network` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.242135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.243533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.249816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cdf49-e657-4c53-942a-45afa16f46e2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:10.258028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:10.259292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:10.260138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 419/817] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:10.262140 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.301949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.302838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.303276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.303570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.305011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:10.305551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.307148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.320443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 399/818] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.321360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.371401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.391750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.399617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10324767-30b4-4e74-9270-5a7484363d4e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.453357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a038d-9c10-4c71-8003-ef63d2462708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.453588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375cd9a-ce8e-4455-b7a1-95d226f3885e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.454741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a038d-9c10-4c71-8003-ef63d2462708 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.455222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a038d-9c10-4c71-8003-ef63d2462708 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.455610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a038d-9c10-4c71-8003-ef63d2462708 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/8f175454d9b245fc88b69aa73568b5d4/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.478305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a038d-9c10-4c71-8003-ef63d2462708 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=8f175454d9b245fc88b69aa73568b5d4, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.480214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a038d-9c10-4c71-8003-ef63d2462708 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.503696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.503929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 420/819] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:10 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/8f175454d9b245fc88b69aa73568b5d4/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:10.504283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.504575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.504849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.505614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:10.505814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09341c6-4ea8-40c3-8e73-874aa637d717 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.505920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.506254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09341c6-4ea8-40c3-8e73-874aa637d717 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.506710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09341c6-4ea8-40c3-8e73-874aa637d717 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.509045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 421/820] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:10.509731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09341c6-4ea8-40c3-8e73-874aa637d717 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.513414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.532009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 400/821] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.534004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.709259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09341c6-4ea8-40c3-8e73-874aa637d717 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.719022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066963fe-38b9-4204-9fa3-5acff2636778 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.722277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.768071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.769798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.769798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.770083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.770698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] RBAC: Adding query filter params (name=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:10.771236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.773344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c4e75-6b15-4d07-950c-c47518e5bc81 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.787125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.787424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 422/822] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/services?name=network => generated 125 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.787557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.787557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.787781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.787895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/d2e01af3550b4e638343e176888a21aa/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.788010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.788010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.790991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=d2e01af3550b4e638343e176888a21aa, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.793592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.820288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 401/823] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:10 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/d2e01af3550b4e638343e176888a21aa/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:10.820288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.820604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:10.820604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:10.824037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.950988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 423/824] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:10 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:10.951949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.007566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f82d0-5db4-460b-bd23-04a0d317678c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.050744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.051608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.052100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.052751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.068093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.073377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:11.098965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:11.100494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 402/825] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:11.102166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.115771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ea59-daa0-4590-9a15-997a557051cf None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.140764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.258351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244851b-5cc9-435e-8184-765c7d081d8b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.310641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.311939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.312572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.313239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.314726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.318256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:11.339485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:11.340655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:11.341941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:11.346699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 403/826] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:11.354809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.427580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.429279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.430195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.430690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.431760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] RBAC: Adding query filter params (type=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:11.432277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.433997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.441640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 424/827] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/services?type=network => generated 352 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:11.442985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.449189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.585884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca75f6-30ea-4858-89fe-f7e09c7d57ad None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.624362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.632967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.635727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.636641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.637143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.639041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:11.639574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.641692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.653465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 425/828] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:11.655239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.676251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2da05-f406-4e11-831b-146a6656454d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.771756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.773377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.774814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.775399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.776518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.778404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:11.779205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.783463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.820019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 404/829] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:11.821271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.839351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a9501-b361-440a-9321-6adf8d6c06ce None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.896581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.898008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.898769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.899281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.900630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.903070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.933280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 426/830] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:11 2022] POST /identity/v3/endpoints => generated 329 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:11.935129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:12.031535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8adb7f-c442-4c15-9053-eaf7a535ea1f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:12.141920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:12.142516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.142798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.143074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.143809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:12.144111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:12.145550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:12.156524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 405/831] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:12.192548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9528df-53bb-47f3-b6ee-e8be8f5277af None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:12.232035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:12.252889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7d290-c874-4d03-a564-5732221a5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:12.253932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d290-c874-4d03-a564-5732221a5e85 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.254221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d290-c874-4d03-a564-5732221a5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.254497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d290-c874-4d03-a564-5732221a5e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.368280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7d290-c874-4d03-a564-5732221a5e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:12.370469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7d290-c874-4d03-a564-5732221a5e85 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:12.555590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 427/832] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:12.561499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:12.566624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:12.704673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b575024-aaf5-4dec-8855-3c8f8d7f1967 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:12.756396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:12.757893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.758410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.758895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.778723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:12.781235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:12.805735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b956-b7f5-41cd-842a-e13943937c55 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.805964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b956-b7f5-41cd-842a-e13943937c55 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.806295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b956-b7f5-41cd-842a-e13943937c55 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.807973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 428/833] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:12.808378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:12.809462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:12.810413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:12.810413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:12.810413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:12.810413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:12.814036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.814386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 406/834] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:12.814528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.814748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.823760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:12.846832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:12.848366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:12.873674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:12.894644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:12.949775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 429/835] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:12 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:12.956215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3030455-7b57-42fe-a994-d34846804c84 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:12.974802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.010854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.012149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.012649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.013284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.014284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:13.014823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.016463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.036039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 407/836] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:13.037464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.126664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4573c-0f71-4633-a28a-c30803fbf83f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.159934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f67277-47e7-4841-932f-77b8b7399e53 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.182134 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.183010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.183313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.183588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.184312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.197916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:13.208545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:13.209802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:13.210721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:13.211605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.213228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.213719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.214161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.216073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 430/837] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:13.217818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.224769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.226775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.236499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:13.245815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:13.246759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:13.247876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:13.257307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 408/838] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:13.258738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.340333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e620059-3b9a-447e-a341-7016ba7d633a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.383538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e797f-af5d-4650-a5d7-d1ac4954707a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.394920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.395618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.395905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.396185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.396951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:13.397324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.398749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c1fe5-778e-4877-abda-4d4178d36d0b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.408441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 431/839] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:13.409919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64898-f96b-40b5-8e41-e171f6ecdfe0 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.410213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64898-f96b-40b5-8e41-e171f6ecdfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.410488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a64898-f96b-40b5-8e41-e171f6ecdfe0 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.411913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 432/840] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:13.417945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a64898-f96b-40b5-8e41-e171f6ecdfe0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.434780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.435747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.435747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.436018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.436798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:13.437191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.438661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0a6f-73f1-452f-ac41-2cdc3b6c67d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.455972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 409/841] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:13.457371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.457654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.457926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.498285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:13.499337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:13.539596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.541565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.577144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a64898-f96b-40b5-8e41-e171f6ecdfe0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.596898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 410/842] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:13 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:13.600792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.643475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.644324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.644686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.645058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.657907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.660108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:13.683709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:13.684795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:13.685820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:13.685820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:13.685820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:13.685820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:13.685820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 433/843] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:13.685820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.776868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b920-1833-4d29-a5b9-0eaf0c5c43a1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.825244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.827229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.827404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.827902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.829223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=15cfb6d527464ccaad7db841e3eacf7c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:13.829672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.831026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.853159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 411/844] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/role_assignments?user.id=15cfb6d527464ccaad7db841e3eacf7c&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:13.853159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.857501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ea6b-3b28-46af-bd9a-96d1b6c6a03d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.900900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.902530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.918898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.920607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.921371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.921951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.937924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:13.947738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:13.948921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:13.950158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:13.950871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 434/845] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:13.958374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.012423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03e100-bfd5-49f6-bb2c-45f31c1283ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.053379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.054323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.054727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.054985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.055727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.056045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.058260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.072426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 412/846] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.081033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.140035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28b894-b778-4de2-b436-54f55ed917fc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.185509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.186613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.187110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.188427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.189393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.189878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.191479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.207417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 435/847] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:14.216698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.227813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.251109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691e9f-741e-4d41-87bd-2fda8beb1739 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.304586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.315260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.316341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.316793 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.317255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.325731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.327543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:14.344562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:14.345838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:14.346780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:14.349364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 413/848] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:14.355539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.383989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7ed5-3600-4a6e-9d7c-997f3ca9cb99 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.432266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.433882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.434629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.435089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.450313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.452969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:14.475024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:14.476503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:14.483153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:14.483153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:14.483153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:14.483153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:14.483153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 436/849] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:14.484356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.494681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c467b-c854-4116-8601-78a91bb946ce None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.549169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.549935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.550280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.550531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.551394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.551702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.553243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.578524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 414/850] 10.222.0.113 () {56 vars in 1154 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.580033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.593970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.627769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124ebaa-8c42-478f-82f4-02b62dc1c508 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.630284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.679078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.679781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.680070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.680350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.681087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.681429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.682824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7751d-70f8-4dfb-85e3-08f8efeee38e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.696003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 437/851] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:14.700742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f1be-2966-408e-aa40-98d1ab6734b9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.700742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f1be-2966-408e-aa40-98d1ab6734b9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.700742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f1be-2966-408e-aa40-98d1ab6734b9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.704138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 438/852] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:14 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:14.705045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f1be-2966-408e-aa40-98d1ab6734b9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.726674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3512c-5244-469b-9bc1-c8581ab13359 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.766306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.767024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.767307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.767871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.836379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f1be-2966-408e-aa40-98d1ab6734b9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.869139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.870623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.881442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.881606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.883036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.883526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.883995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.896918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.899747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-1613791d-76ef-4841-8f4e-1b5228a8f9a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:14.925656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:14.927241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:14.928860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 439/853] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:14.929875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.929875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.930088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.949870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:14.951172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:14.975791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.005914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 415/854] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:15.007133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.034963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 440/855] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:14 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:15.036148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.133195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8763-a662-43f3-964b-3a5a2549d488 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.143183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.169804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9402-a039-4e52-8599-d67d9c862ebd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.172233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.173043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.173428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.173717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.174580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:15.174893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.176357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.207002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 416/856] 10.222.0.113 () {56 vars in 1140 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:15.207711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.218569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.220216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.220646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.221494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.242214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.243803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:15.266699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:15.274116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:15.275224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:15.275224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:15.275224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:15.275224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:15.275224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 441/857] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:15.275224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.277786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.340125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f406-f7e3-4a57-80cc-c21f9dd6b50d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.396599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.397338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.397625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.398031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.398866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.400321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.425151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 417/858] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:15 2022] POST /identity/v3/services => generated 252 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:15.425151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.430234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068472ff-f4a4-42d0-ab8e-c0cbd9a80b87 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.449099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.500200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.501383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.501723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.502283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.552215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b457bfd-149f-4f29-b1f6-a8245190b19c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.590552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.593411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.594093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.594362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.594742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.595110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.595983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:15.596405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.596634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.598188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.614151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 418/859] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:15.619893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.735756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.753303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 442/860] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/auth/tokens => generated 1254 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:15.755386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.761314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91baa38-e487-4037-9528-9f0cdfa22783 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.809948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.811131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.811574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.812016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.822274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.824675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:15.844051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:15.845242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:15.846322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:15.849868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 419/861] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:15.856098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:15.888382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:15.893492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26384-2235-4f09-947e-94d092ba6854 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:15.943947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:15.945015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:15.945338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:15.945609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:15.961367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:15.963110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:15.987957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:15.988929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:15.989966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:15.989966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:15.989966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:15.989966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:15.993273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 443/862] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:15.995901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.000500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df3cc-cfac-4c5b-b264-1666dcce3d63 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.049572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.050819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.051359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.051910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.053178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:16.053921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.055791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.075638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 420/863] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:16.076905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.087159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:16.127320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fb473-a415-4de2-8a54-61817def8d37 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.167709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.168688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.168931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.169241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.169968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:16.170272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.171725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216be30-6c20-419b-8508-ddfb267b33c2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.185303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 444/864] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:16.185303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ca02-c545-4bc7-a1bf-4a87e2e4b184 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.185555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ca02-c545-4bc7-a1bf-4a87e2e4b184 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.185829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ca02-c545-4bc7-a1bf-4a87e2e4b184 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.187504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 445/865] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:16.192072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ca02-c545-4bc7-a1bf-4a87e2e4b184 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.206774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a188-9fd2-4c82-88c9-a1f175518a9b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.209198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:16.244682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.245351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.245641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.245918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.246760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=8f175454d9b245fc88b69aa73568b5d4) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:16.247103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.248665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a0447-7fc3-4ebf-a5c0-0d1ab1e1fa59 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.264620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 421/866] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/role_assignments?user.id=8f175454d9b245fc88b69aa73568b5d4&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:16.264620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.264620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.264620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.281608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:16.283106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:16.346144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ca02-c545-4bc7-a1bf-4a87e2e4b184 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.365153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:16.372120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 422/867] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:16 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:16.395060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.395939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.396215 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.396486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.397577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.405933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.408251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:16.429935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:16.430912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:16.431815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 446/868] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:16.437459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.534697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:16.541760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b51b-aa75-4978-b5b0-7e00cd6a59f1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.574588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006844-03f4-4e83-ae0b-06a5faf6cc95 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.589189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.590102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.590449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.590755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.591435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.593324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:16.606262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:16.607334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:16.608242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 423/869] 10.222.0.113 () {56 vars in 1137 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:16.615276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.634090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.634766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.635056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.635337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.636470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:16.636600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.638127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.652157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 447/870] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:16.657665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.693045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:16.741677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e4dd2-4429-4ac2-b8d1-05d219a1407b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.796653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.797384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.797674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.797956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.798792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:16.799149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.800839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.807140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 424/871] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:16.813147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:16.813932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d78b7e-789f-4414-9267-7abcde295b40 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.846237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:16.852057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:16.853098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.853633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.854113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.855489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=d2e01af3550b4e638343e176888a21aa) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:16.856012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:16.857790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaab14-3e3e-4354-9541-57007e77e8fa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:16.864985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 448/872] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/role_assignments?user.id=d2e01af3550b4e638343e176888a21aa&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:16.961440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e3af1-d7e8-43b3-9fc9-33de68994f02 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:16.998023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:17.007532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:17.008341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.008529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.008785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.009578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:17.009892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:17.011417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfd7c2-b6c7-4c2d-b359-57c9375acdf5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:17.017750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 425/873] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:16 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:17.651510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f254-5143-4cfd-9644-f21345c2533c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.652208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f254-5143-4cfd-9644-f21345c2533c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.652681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f254-5143-4cfd-9644-f21345c2533c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.654597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 449/874] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:17.660447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.661001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.661514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.680981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:17.682626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:17.757687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 426/875] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:17 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:17.785416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f254-5143-4cfd-9644-f21345c2533c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:17.917157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f254-5143-4cfd-9644-f21345c2533c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:17.953446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:17.954307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.954589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.954859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.955517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:17.956954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:17.969040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:17.970037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:17.970882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 450/876] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:17.980534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.100063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aebb23-e688-45f7-9fec-a58b9d39b825 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.128908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.147469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.148440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.148731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.149024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.149846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:18.150159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.151626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.157529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 427/877] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:17 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.165051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.260824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.312243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261b49-1f84-491f-8c75-1c3aae383599 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.348068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.349111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.349631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.350126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.351116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:18.351619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.353210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.359425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 451/878] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.365473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.471005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27099279-e31a-4876-8325-6628f79cab5e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.507828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.508497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.508776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.509050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.509891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] RBAC: Adding query filter params (interface=public, service_id=8e462f50810242cabab82644f0a0a7d7, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:18.510199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.511784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698000b3-8f4b-4760-b508-3ed68b677b1d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.518052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 428/879] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/endpoints?service_id=8e462f50810242cabab82644f0a0a7d7&interface=public®ion_id=RegionOne => generated 195 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.524312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.630749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4441b-048a-47e0-b83e-8789856ce612 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.656178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.669531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f96524-8a24-43a0-8337-7a3508f83b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.670231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f96524-8a24-43a0-8337-7a3508f83b9a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.670510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f96524-8a24-43a0-8337-7a3508f83b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.670834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f96524-8a24-43a0-8337-7a3508f83b9a None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.671525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f96524-8a24-43a0-8337-7a3508f83b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.672915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f96524-8a24-43a0-8337-7a3508f83b9a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.679483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 452/880] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/services => generated 1016 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:06:18.808580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb397779-a139-4b85-9a8a-106e6a0c77ba None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.808763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb397779-a139-4b85-9a8a-106e6a0c77ba None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.809032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb397779-a139-4b85-9a8a-106e6a0c77ba None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.810709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 429/881] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:18.818900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.819850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.820412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.840624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:18.842202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:18.914325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 453/882] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:18 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:18.937196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb397779-a139-4b85-9a8a-106e6a0c77ba None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.993238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.048369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb397779-a139-4b85-9a8a-106e6a0c77ba None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.085504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfec16b-8cb0-4ad6-aa4b-c3752736c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.086336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec16b-8cb0-4ad6-aa4b-c3752736c74a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.086615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec16b-8cb0-4ad6-aa4b-c3752736c74a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.086888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec16b-8cb0-4ad6-aa4b-c3752736c74a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.097889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfec16b-8cb0-4ad6-aa4b-c3752736c74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bbfec16b-8cb0-4ad6-aa4b-c3752736c74a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:19.106913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:19.108322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:19.109804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 430/883] 10.222.0.113 () {56 vars in 1125 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:19.114482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.118658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddef2e-72b7-400e-8bff-6fab5854c10f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.118944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddef2e-72b7-400e-8bff-6fab5854c10f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.119274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddef2e-72b7-400e-8bff-6fab5854c10f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.120880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 431/884] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:19.126383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.126685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.126960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.147016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:19.148373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:19.230786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478f229-bd88-4e27-b8ba-1a97f5db41ed None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.239676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 432/885] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:19 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:19.250911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.259951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.273577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.274563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.275262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.275721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.276675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:19.277146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.278917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.291034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 454/886] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:19.296819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.311708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.387902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e82d1-d643-4de0-85d4-e0e3f6b03b37 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.417821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c20e42-4317-4085-afbc-04b7ad00f272 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.425660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.426567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.426852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.427131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.427801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.429283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a1627489-0cf3-40b1-aff7-c83e6ca653f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:19.442489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:19.443611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:19.444614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 433/887] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:19.445599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb387b-3e04-4a2b-9fa9-7b75fedb5418 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.445599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb387b-3e04-4a2b-9fa9-7b75fedb5418 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.445599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb387b-3e04-4a2b-9fa9-7b75fedb5418 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.451128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 434/888] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:19.451128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb387b-3e04-4a2b-9fa9-7b75fedb5418 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.467361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.468285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.468631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.468899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.482007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.483508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d21539b3-b2ad-4640-9fae-66eea1154e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:19.502616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:19.503600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:19.504491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:19.504491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:19.504491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:19.504491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:19.504491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 455/889] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:19.505433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.505719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.505997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.528668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:19.529913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:19.560141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.577707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb387b-3e04-4a2b-9fa9-7b75fedb5418 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.580727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.603639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 456/890] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:19 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:19.609519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.621639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.622345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.622631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.622914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.623636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:19.623946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.625358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.630623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 435/891] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:19.631337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.720917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9b892-5991-4a4d-93d4-73883a3860c3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.734974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b039-bfa4-43e4-8006-6366cb280fe6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.761286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.761956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.762235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.762504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.763222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:19.763522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.764902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.771965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.773033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.773501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.773782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.774526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.775893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.781331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 457/892] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:19.781331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.794758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 436/893] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:19 2022] POST /identity/v3/services => generated 270 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:19.795848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.820063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.847208 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.927559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381279-c7af-432d-9e1f-923da4967d24 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.956505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1f8b-141b-4733-af84-6b0ab5ca0404 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.975531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.976079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.976515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.976791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.978061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:19.978169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.979508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.987079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 458/894] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:19.997669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.998526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.998802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.999074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.009519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.011075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:20.029704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:20.030753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:20.031761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 437/895] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:20.036670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.134482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.151794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1303ca0-6657-441f-8c0e-aaa54cd339db None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.187758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.188386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.188663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.188937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.189798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:20.190108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.191554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.211368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 459/896] 10.222.0.113 () {56 vars in 1154 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:20.218297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.323870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc61ada-cdb2-4008-997a-f207c117b65d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.331288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.359784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.360443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.360723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.360993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.430557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.432181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.521885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.534027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 438/897] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/auth/tokens => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:20.542399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.654462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb81fc-0e0d-45c3-916c-b82a740d8b2c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.691874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.693061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.693601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.694249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.706478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.709251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.713640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a128a4dd-ca40-4343-bb8a-0153133c7bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:20.731505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:20.732544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:20.733473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:20.733473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:20.733473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:20.733473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:20.735740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 460/898] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:20.742012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.808901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2820b-1f14-4aa0-bd83-ad3870a2ff0a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.809713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2820b-1f14-4aa0-bd83-ad3870a2ff0a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.810188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2820b-1f14-4aa0-bd83-ad3870a2ff0a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.812327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 461/899] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:20.818339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.818617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.818951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.838033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:20.839259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:20.866220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b3aa1-227c-43bd-b597-69f16ad8d7f6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.916846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.918204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.918928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.919803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.921042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:20.921583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.923322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.929604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 462/900] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:20 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:20.938295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 439/901] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:20.944689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.952555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.007863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.067299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4936753-7e43-49ff-ad2d-355d9a54609d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.077763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c5a1-bb22-4006-9a2f-3a1a10610a61 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.099433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.110385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.111261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.111563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.111853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.120010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.121532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.122806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.123974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.124505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.124989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.125885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.127463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:21.136266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:21.137567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:21.138500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:21.142401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 463/902] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:21.143878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:21.145406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:21.146482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:06:21.147585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:21.150946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 440/903] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:21.157497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.263933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17592b17-e636-452d-b04b-b29cabae0097 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.300973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54675d6d-9271-4400-af8d-808c2a2d51ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.301852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.302812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.303134 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.304627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.305477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.305787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.307248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.311827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.333378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 464/904] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:21.335160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.346587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.347279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.347568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.347852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.349055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.349396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.351295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.360611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 441/905] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.366379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.403049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.474540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c44074-fc7b-40aa-b034-36ea06cd85aa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.490455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155845e-6e5f-4f56-8eab-f36fa41122ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.523312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.524408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.524792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.525200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.526311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] RBAC: Adding query filter params (role.id=336029da93054d1d985ddc2f739d385e, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=8f175454d9b245fc88b69aa73568b5d4) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.527135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.529045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.535660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.536746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.536874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 465/906] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/role_assignments?user.id=8f175454d9b245fc88b69aa73568b5d4&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=336029da93054d1d985ddc2f739d385e => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.539154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.539866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.541459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.542260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.544883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd994f-da02-44a0-9971-446721758d19 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.551753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 442/907] 10.222.0.113 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.558179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.675746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ec83e-cecd-49b1-b250-fef48200d0b6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.688511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.716651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa543c50-9740-48d6-8c96-d0ba1751e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.717366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa543c50-9740-48d6-8c96-d0ba1751e7eb None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.717657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa543c50-9740-48d6-8c96-d0ba1751e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.717933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa543c50-9740-48d6-8c96-d0ba1751e7eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.718763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa543c50-9740-48d6-8c96-d0ba1751e7eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.720189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa543c50-9740-48d6-8c96-d0ba1751e7eb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.744527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 466/908] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:21 2022] POST /identity/v3/endpoints => generated 348 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:22.042738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af3ea3-3df5-44af-af1b-c1fd5057de16 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.043082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af3ea3-3df5-44af-af1b-c1fd5057de16 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.043206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af3ea3-3df5-44af-af1b-c1fd5057de16 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.044861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 443/909] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:22.051221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0438-3582-4b7f-99a7-e6bec2d33105 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.051706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0438-3582-4b7f-99a7-e6bec2d33105 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.052199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0438-3582-4b7f-99a7-e6bec2d33105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.082826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8c1e0438-3582-4b7f-99a7-e6bec2d33105 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:22.084929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8c1e0438-3582-4b7f-99a7-e6bec2d33105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:22.205536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 467/910] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:22 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:22.227792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af3ea3-3df5-44af-af1b-c1fd5057de16 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.259436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547caf22-f263-483e-b32b-d11edfea550d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.259814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547caf22-f263-483e-b32b-d11edfea550d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.260036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547caf22-f263-483e-b32b-d11edfea550d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.261661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 468/911] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:22.266831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.267112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.267388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.270586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.287262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:22.289031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:22.352642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af3ea3-3df5-44af-af1b-c1fd5057de16 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.377142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 469/912] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:22 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:22.403691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.408178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.409031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.409350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.409628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.410348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.411824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:22.428517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:22.429928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:22.430943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 444/913] 10.222.0.113 () {56 vars in 1137 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:22.435938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.471655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.540374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.543165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd5a74-0245-4bd3-b5eb-2b49e602e45a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.544083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1bba5-f47e-4851-aee2-9c2279bff0c2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.584091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.585266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.586018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.586403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.586519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.586922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.587084 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.587490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.587975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:22.588381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.588850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.590207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.590621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.605637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 445/914] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:22.607517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.617158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 470/915] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:22 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:22.747987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7780f-a527-4560-9116-d084986a56f2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.797220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.798061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.798431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.798803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.799656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:22.799972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.801415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.807711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 446/916] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:22.813587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.908483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.930677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b0c9-f489-4c25-8027-58e6084a27ed None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.967630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.968643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.969097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.969569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.970618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] RBAC: Adding query filter params (interface=public, service_id=8ca32dcecbe841798bd759525fbf9da9, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:22.971102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.972722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403eb7a-d31a-41a5-b53b-f1e48e24f1c6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.978664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 471/917] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/endpoints?service_id=8ca32dcecbe841798bd759525fbf9da9&interface=public®ion_id=RegionOne => generated 195 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:22.990348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:23.018346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:23.101980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5a47-b039-49f2-b54e-e695688b5d16 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:23.142882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddb7dd-85b5-46bf-8861-f6b2f24f06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:23.143908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddb7dd-85b5-46bf-8861-f6b2f24f06f1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.144367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddb7dd-85b5-46bf-8861-f6b2f24f06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.144819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddb7dd-85b5-46bf-8861-f6b2f24f06f1 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.145719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddb7dd-85b5-46bf-8861-f6b2f24f06f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:23.147514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddb7dd-85b5-46bf-8861-f6b2f24f06f1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:23.154575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 447/918] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/services => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:06:23.773929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46cfb3-ec97-4bc9-aaf4-f3e78f2d9248 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.774443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46cfb3-ec97-4bc9-aaf4-f3e78f2d9248 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.774708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46cfb3-ec97-4bc9-aaf4-f3e78f2d9248 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.776731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 472/919] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:23.783046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea72c5-3e10-4221-b28f-1e1561962e22 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.783523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea72c5-3e10-4221-b28f-1e1561962e22 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.783598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea72c5-3e10-4221-b28f-1e1561962e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.806130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c9ea72c5-3e10-4221-b28f-1e1561962e22 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:23.807381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c9ea72c5-3e10-4221-b28f-1e1561962e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:23.892698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 448/920] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:23 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:23.914994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46cfb3-ec97-4bc9-aaf4-f3e78f2d9248 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.023577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f3309-86de-49d1-bd2e-8dd4a0a9adb1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.023911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f3309-86de-49d1-bd2e-8dd4a0a9adb1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.024193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f3309-86de-49d1-bd2e-8dd4a0a9adb1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.025987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 449/921] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:24.030822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.031110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.031294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46cfb3-ec97-4bc9-aaf4-f3e78f2d9248 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.031408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.050620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:24.051887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:24.067775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.068270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.069739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.070370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.070654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.091203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:24.108606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:24.110774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:24.112039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 473/922] 10.222.0.113 () {56 vars in 1125 bytes} [Mon Jul 25 19:06:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:24.120563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.136650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.139166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 450/923] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:24 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:24.162449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.251570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8992-bd80-4ef4-96e9-49a08c8697e3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.293159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.293775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.294057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.294333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.295091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:24.295399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.297579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.302651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0939ac-84be-4c0e-b60c-7229e9afc60b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.307307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 474/924] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:24.312759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.342541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.343652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.344174 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.344661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.345881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.347676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.351089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING keystone.server.flask.common [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 19:06:24.373162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.sql.core [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 19:06:24.373162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 19:06:24.373162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [parameters: {'id': 'e237eed20f974db58c69cc91ccb5663c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 19:06:24.373162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80508) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 19:06:24.398299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e237eed20f974db58c69cc91ccb5663c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e237eed20f974db58c69cc91ccb5663c. Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:06:24.404191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result.read() Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 19:06:24.405073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application yield resource Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise self.value Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application session.commit() Jul 25 19:06:24.406137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.session.flush() Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application compat.raise_( Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 19:06:24.407059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 19:06:24.409177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application result.read() Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:06:24.410306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [parameters: {'id': 'e237eed20f974db58c69cc91ccb5663c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.413410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:24.415354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e237eed20f974db58c69cc91ccb5663c. Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.417586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 451/925] 10.222.0.113 () {60 vars in 1145 bytes} [Mon Jul 25 19:06:24 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:24.422933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.429534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.456548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be64eb9-3beb-46e6-9449-d5a989bbd865 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.505317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.507361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.507830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.508312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.523422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.525203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.540277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b23d3-83e6-457e-857a-59ef9d92d8e6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:24.551602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:24.552717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:24.553876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:24.553876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:24.553876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:24.553876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:24.556471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 475/926] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:24.563083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.595562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.596732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.597264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.597682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.607538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.609602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:24.625239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:24.626274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:24.627183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:24.631756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 452/927] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:24.633357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.697705 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374cecb-529c-41dd-8353-f85898d85b04 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.699807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.740464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.744705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be2f76-0573-48b4-92fe-514c4f6b2b95 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.761645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.762339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.762624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.762996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.763629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:24.764005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.765576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.780170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 476/928] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:24.785804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.786617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.787931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.788423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.788951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.790191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:24.790724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.792546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c200-af3d-46c4-bab1-0f23be2aa9bd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.824250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 453/929] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:24.838440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755737-c931-4a1a-bcc0-e3d575cd886b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.838822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755737-c931-4a1a-bcc0-e3d575cd886b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.839059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755737-c931-4a1a-bcc0-e3d575cd886b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.840569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 454/930] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:24.849341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.849674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.849911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.871769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:24.874109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:24.904574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2fc5-8d6e-4e18-a73c-b6e79469f448 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.944337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.945210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.945498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.945772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.952103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 455/931] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:24 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:24.954686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.956205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:24.972929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:24.974218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:24.975745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 477/932] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:24.981015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.984022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.036955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.054562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.115611 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c42392-ef1f-40b0-b932-26fd0493b687 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.120062 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796a306-5d56-4ea6-86a6-3d96efa122a6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.155897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.157078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.157581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.158078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.158930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.159045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.159694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.159975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.160248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.161091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.161426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.161641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.164865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:25.174774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:25.175956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:25.176835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.179898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 456/933] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:25.185166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 478/934] 10.222.0.113 () {56 vars in 1154 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.185586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.190495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.303518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4086373-6805-4d69-bd96-3abe3d786e3a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.310797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.315623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4391d6-4348-4946-91d9-61762d51687f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.325025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.353540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.354494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.355089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.355366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.356092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.356402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.357838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb03e7d-8ce6-4a43-90f7-56b44abb8239 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.359862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.360951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.361541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.361884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.364161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 457/935] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:25.371787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b07a-35df-4465-9e0c-c2197a12111a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.372512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b07a-35df-4465-9e0c-c2197a12111a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.372806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b07a-35df-4465-9e0c-c2197a12111a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.376771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.376932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 458/936] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:25.376932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b07a-35df-4465-9e0c-c2197a12111a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.380198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-727d61dd-e7d9-4d9b-888f-29eb797cdf00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:25.400339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:25.401463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:25.402454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:25.402454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:25.402454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:25.402454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:25.402454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 479/937] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:25.403945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.404229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.404501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.436334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:25.437823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:25.517652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b07a-35df-4465-9e0c-c2197a12111a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.522279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 480/938] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:25 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:25.523344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.568432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.569474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.569984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.570269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.570990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.571301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.572784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.578336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 459/939] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.582070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.629094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.635523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.653430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb03a6-fce5-4ebe-a6da-26b1ad894f0c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.694667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.695371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.695766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.696048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.696788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.697096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.698570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.698964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d721619-9324-41a5-8f96-8d857006574f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.717432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 481/940] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.717432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.757412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.759306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.759827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.760287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.761499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.764054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:25.788277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:25.789900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.790866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 460/941] 10.222.0.113 () {56 vars in 1137 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:25.792297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.842723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f0ea-e880-411d-af40-e7535243b515 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.887131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.888507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.888985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.889626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.891210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] RBAC: Adding query filter params (interface=public, service_id=5f0b9b66179848329a5e6f0d77c41458, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.891817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.894138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.902387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 482/942] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/endpoints?service_id=5f0b9b66179848329a5e6f0d77c41458&interface=public®ion_id=RegionOne => generated 195 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.903969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.909730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4f236-7d13-4a9a-b4cc-571da4520f53 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.911961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.922124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.948388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.949336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.949630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.950112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.958074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.959799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:25.977641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:25.978708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:25.979953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 461/943] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:25.980457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.045420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0955d5-86c7-4f62-9cb1-54c3412adc05 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.082057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.083069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.083529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.083809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.084633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:26.084948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.086469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.092344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 483/944] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:26.093227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.106311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8626e1-c676-4a65-860a-9806bd7525c0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.147651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.148266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.148539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.148819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.149549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.151269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.169150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 462/945] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/services => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:06:26.169150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.182974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.224673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a366-ddad-4567-b74a-c3cc88f7c258 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.225675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.271205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.272191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.272484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.272770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.273632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:26.273944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.275648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.301319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 484/946] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:26.302502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.354158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44614-47c3-4b01-9d98-a7343ac2075e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.406690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.407671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.408115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.408583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.409915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:26.410426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.413035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.424250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 463/947] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:26 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:26.430649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.452995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9c32b-33cc-4a7a-85ce-9427209d3c07 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.484475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.494389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d206c5-e89b-41c5-965b-7083d867ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.495770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d206c5-e89b-41c5-965b-7083d867ca02 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.496257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d206c5-e89b-41c5-965b-7083d867ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.496736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d206c5-e89b-41c5-965b-7083d867ca02 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/8f175454d9b245fc88b69aa73568b5d4/roles/336029da93054d1d985ddc2f739d385e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.499294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d206c5-e89b-41c5-965b-7083d867ca02 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=8f175454d9b245fc88b69aa73568b5d4, role_id=336029da93054d1d985ddc2f739d385e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.500994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d206c5-e89b-41c5-965b-7083d867ca02 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.525844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 485/948] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:26 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/8f175454d9b245fc88b69aa73568b5d4/roles/336029da93054d1d985ddc2f739d385e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:26.589301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.602798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a80ae-05d9-400f-8999-5a9ab0e3b6bd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.646177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc665-dce1-4548-a4f2-474f6b2b0767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.646971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc665-dce1-4548-a4f2-474f6b2b0767 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.647322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc665-dce1-4548-a4f2-474f6b2b0767 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.647828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc665-dce1-4548-a4f2-474f6b2b0767 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.648626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc665-dce1-4548-a4f2-474f6b2b0767 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.650192 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc665-dce1-4548-a4f2-474f6b2b0767 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.679328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 464/949] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:27.295308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68d23-446d-40df-91d3-4fda29ae5380 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.295853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68d23-446d-40df-91d3-4fda29ae5380 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.295853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68d23-446d-40df-91d3-4fda29ae5380 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.304925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 486/950] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:27.310992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.311904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.312668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.335398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:27.336995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:27.433189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 465/951] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:27 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:27.458124 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68d23-446d-40df-91d3-4fda29ae5380 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.573813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68d23-446d-40df-91d3-4fda29ae5380 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.611370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.612065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.612349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.612626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.613374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:27.614844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:27.617610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING keystone.server.flask.common [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 19:06:27.630710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.sql.core [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 19:06:27.630710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 19:06:27.630710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [parameters: {'user_id': '2c36fc1619974e138446b336c5656a8a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 19:06:27.630710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80507) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 25 19:06:27.638831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:06:27.639747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application yield resource Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise self.value Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application session.commit() Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 19:06:27.641242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.flush() Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application compat.raise_( Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 19:06:27.642195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:06:27.643131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:06:27.644008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [parameters: {'user_id': '2c36fc1619974e138446b336c5656a8a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:27.644858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 19:06:27.648594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:27.654464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 487/952] 10.222.0.113 () {60 vars in 1136 bytes} [Mon Jul 25 19:06:27 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:27.657157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.746270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.769769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c981-54a0-4a40-9e49-c25cf03da3c1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.811480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.812690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.813244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.813719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.824809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:27.826614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-3eab96ad-7aca-47b9-8571-0887d474bf2c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:27.844808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:27.845874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:27.846826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:27.854862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 466/953] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:27.856763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.913919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.970553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38175669-dbf5-4e2c-8b56-fa28a9965200 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.009679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.010929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.011435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.011929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.012942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:28.013477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.015344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236b647-e604-418a-b0e4-4e6df3302209 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.063441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 488/954] 10.222.0.113 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:28.386282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23b7e-362d-4921-a952-f47c4d0cd254 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.386785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23b7e-362d-4921-a952-f47c4d0cd254 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.386785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23b7e-362d-4921-a952-f47c4d0cd254 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.388411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 467/955] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:28.395158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08622-cc37-40b7-896c-87856ee5e089 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.395158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08622-cc37-40b7-896c-87856ee5e089 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.395158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08622-cc37-40b7-896c-87856ee5e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.413478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-26e08622-cc37-40b7-896c-87856ee5e089 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:28.415006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-26e08622-cc37-40b7-896c-87856ee5e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:28.497462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 489/956] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:28 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:28.519694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23b7e-362d-4921-a952-f47c4d0cd254 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.626632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23b7e-362d-4921-a952-f47c4d0cd254 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.667316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.668116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.668397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.668721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.669444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.670850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.681100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438bb91-7834-47d2-aaa8-425906b81def None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.681464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438bb91-7834-47d2-aaa8-425906b81def None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.681659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438bb91-7834-47d2-aaa8-425906b81def None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.683254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 490/957] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:28.684145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:28.685391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:28.686501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:28.688212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.688497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.688746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.689497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 468/958] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:28.691181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.695370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.709036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:28.710503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:28.742691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.793204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 491/959] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:28 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:28.815529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d3db8-ff1f-4b59-ba20-cba235e89ef9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.816015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.850187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.851031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.851315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.851597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.852323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:28.852630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.854039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab493-8792-4f8c-ac3c-a34141cfcdec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.859275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 469/960] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:28.860515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b78494-b01d-40f7-a70a-1404a11f9638 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.860801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b78494-b01d-40f7-a70a-1404a11f9638 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.861078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b78494-b01d-40f7-a70a-1404a11f9638 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.862343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 470/961] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:28.864833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b78494-b01d-40f7-a70a-1404a11f9638 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.925463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66204e-ba84-4b40-b91b-6b32b16e28f2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.932331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.963741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5470e-bbc8-4fd3-ac6d-38984f6352f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.965105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5470e-bbc8-4fd3-ac6d-38984f6352f0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.965618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5470e-bbc8-4fd3-ac6d-38984f6352f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.966098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5470e-bbc8-4fd3-ac6d-38984f6352f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.968569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b78494-b01d-40f7-a70a-1404a11f9638 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.980686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5470e-bbc8-4fd3-ac6d-38984f6352f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-13f5470e-bbc8-4fd3-ac6d-38984f6352f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:28.988969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:28.989941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 492/962] 10.222.0.113 () {56 vars in 1125 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:28.991972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.992755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.992755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.007129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.007814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.008099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.008385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.009104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:29.009442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.010839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.014370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:29.015598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:29.016464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 471/963] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:29.017291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.042079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.093592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 493/964] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:28 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:29.094520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.123874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcb8f9-f24f-42e5-a9e7-cb42d0e4bef7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.154212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.160072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.160746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.161028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.161322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.162073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:29.162499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.163973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.172752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 472/965] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:29.173615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.207726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8361d2-cd65-4b71-ae0d-99cb8e24d075 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.245024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.245724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.246003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.246302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.247039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.248445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.269759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 494/966] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:29 2022] POST /identity/v3/endpoints => generated 351 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:29.270574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.283217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808fa9b-bc4b-4ea7-bfd0-ccee7e01e25b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.288935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.330417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.331245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.331525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.331801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.332492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.333941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:29.347284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:29.348509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:29.349413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 473/967] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:29.357665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.399467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bd9c5-121e-4905-a566-1302044e55ed None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.426555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.442255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.443095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.443383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.444336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.464776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.466245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.484026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d103d-6c1f-4325-bb96-476894b9bc13 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:29.487030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:29.488077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:29.489299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:29.489299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:29.489299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:29.489299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:29.489299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 495/968] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:29.494742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.525944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.526932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.527512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.527795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.528666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:29.528969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.530924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.541749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 474/969] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:29.542950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.571943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.616656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf7a12-25be-4f79-841d-c5f4adcfde97 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.659710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3072-6584-488c-a005-fb1190199b0d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.660935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.661891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.663468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.663468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.664319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:29.664756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.666398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.680596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.686709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 496/970] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:29.687830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.702293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.702979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.703319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.703597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.704340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:29.704645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.706060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.717264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 475/971] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:29.835147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cce7a-edb0-47a5-87c4-f56d78038ea7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.866978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.889400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.890425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.890989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.891504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.902811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.904395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:29.922758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:29.923809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:29.924774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 497/972] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:29.932619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.051773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00709b56-fdf6-4fd5-a318-e8ff53bf3206 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.109140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.110280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.110784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.111436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.113076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:30.113681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.116403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.149354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 476/973] 10.222.0.113 () {56 vars in 1154 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:30.157384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.271057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108c2f-c801-478a-9a5c-3d21897d5cfb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.306424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61651127-9e75-4a87-baca-c632963500cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.307009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61651127-9e75-4a87-baca-c632963500cd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.307291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61651127-9e75-4a87-baca-c632963500cd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.307569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61651127-9e75-4a87-baca-c632963500cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.366763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.386905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61651127-9e75-4a87-baca-c632963500cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.388643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61651127-9e75-4a87-baca-c632963500cd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.508501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.509208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 498/974] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:30.553946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.622471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da2fef-b2e1-474f-9302-5da254bcd6af None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.657688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.658865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.659351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.659825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.670988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.672916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:30.692505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:30.693678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:30.695465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:30.695465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:30.695465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:30.695465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:30.695465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 477/975] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:30.702295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61651127-9e75-4a87-baca-c632963500cd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.807213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.824435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61651127-9e75-4a87-baca-c632963500cd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.865208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.866339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.866809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.867307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.868671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:30.870622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.871840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.890253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 499/976] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:30.891813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.003996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.015014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ba51-aebb-4134-a9bc-b9336ea9c119 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.049682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.050675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.050988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.051275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.058874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.060378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:31.074794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:31.075726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:31.076615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:31.080832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 478/977] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:31.082018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.199004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25106f-a7a3-4547-9654-02b8beaabf44 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.237616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.238297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.238578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.238854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.239640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:31.239968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.241505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422fe6-5730-4a45-97ef-4d57d9096aa6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.255213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 500/978] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.261330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.368164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0bd7f-140a-4cdb-a29c-16258b94f60b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.368542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0bd7f-140a-4cdb-a29c-16258b94f60b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.368779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0bd7f-140a-4cdb-a29c-16258b94f60b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.373773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 501/979] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:31.380671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.381305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.381694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.403881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.413032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:31.414496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74abf-ff38-4e27-beea-cbff2bdb00c8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.414943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:31.468059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.469070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.469391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.469777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.470956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] RBAC: Adding query filter params (role.id=336029da93054d1d985ddc2f739d385e, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=8f175454d9b245fc88b69aa73568b5d4) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:31.471378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.472918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.480843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 479/980] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/role_assignments?user.id=8f175454d9b245fc88b69aa73568b5d4&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=336029da93054d1d985ddc2f739d385e => generated 610 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.526354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 502/981] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:31 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:31.549983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.577285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.695379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de8de3-f197-4648-a40a-305d39a0d49c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.745305 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.746039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.746321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.746594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.747254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.749510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-192098ee-609f-4aaa-bcf5-fa77f8a81835 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:31.767020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:31.768117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:31.769009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 480/982] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:31.776975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.794444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f10d7-a775-466f-bf37-3c50919ea927 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.794730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f10d7-a775-466f-bf37-3c50919ea927 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.795014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f10d7-a775-466f-bf37-3c50919ea927 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.796828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 481/983] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:31.803282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.803776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.804227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.827819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:31.829064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:31.929956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 482/984] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:31 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:31.952391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1f276-280b-40ec-8521-daa749de4f34 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.959837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.974197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.999885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.000930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.001438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.001945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.002730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:32.003032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.004430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.007577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.018727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 503/985] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:32.019928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.109873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622688-6ee0-442f-acf1-932b06bb6b26 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.165149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.166180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.166710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.166997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.167855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.169367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.181707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4be3-11c4-4aa6-9b3d-5d22e756f639 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.192929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 483/986] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:31 2022] POST /identity/v3/services => generated 243 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:32.246724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.247750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.248211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.248661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.249647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:32.250186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.251823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.264706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 504/987] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:32.273060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.400419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.446859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439867cf-46cf-4531-895e-812d5397d090 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.493681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.494766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.495257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.495762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.496789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] RBAC: Adding query filter params (interface=admin, service_id=5f0b9b66179848329a5e6f0d77c41458, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:32.497336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.498954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c34e7-7f0e-435e-bbe2-d28f4a6623cf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.505724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 484/988] 10.222.0.113 () {56 vars in 1254 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/endpoints?service_id=5f0b9b66179848329a5e6f0d77c41458&interface=admin®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:32.512347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.589207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.644115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058c5b-3096-45b2-8ad3-acaa121d5f6e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.701658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d33a7-0284-465c-b335-9102549432c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.702509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d33a7-0284-465c-b335-9102549432c8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.702751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d33a7-0284-465c-b335-9102549432c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.703031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d33a7-0284-465c-b335-9102549432c8 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.703721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d33a7-0284-465c-b335-9102549432c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.705154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d33a7-0284-465c-b335-9102549432c8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.715007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 505/989] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/services => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:06:33.787887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33389827-561d-4446-97c6-ad2fb26c476d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:33.788430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33389827-561d-4446-97c6-ad2fb26c476d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:33.788430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33389827-561d-4446-97c6-ad2fb26c476d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:33.789943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 485/990] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:33.795046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:33.795558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:33.795558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:33.814609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:33.816020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:33.887255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 506/991] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:33 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:33.908958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33389827-561d-4446-97c6-ad2fb26c476d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:34.041813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33389827-561d-4446-97c6-ad2fb26c476d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:34.086322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:34.087172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.087562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.087837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] PATH_INFO: `/v3/services/image` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.088497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:34.089929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:34.091908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:34.106541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:34.107748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:34.108612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:34.110199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 486/992] 10.222.0.113 () {56 vars in 1110 bytes} [Mon Jul 25 19:06:33 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:34.114472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:34.181158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:34.236149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79313d-c3a5-4cd5-a8cf-db62cbe82efa None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:34.289838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:34.290876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.291147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.291430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.292207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] RBAC: Adding query filter params (name=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:34.292456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:34.293857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cca0b-b7f8-4666-911f-481bee02265d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:34.305839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 507/993] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:34 2022] GET /identity/v3/services?name=image => generated 123 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:34.306921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:34.386767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639868f3-688f-4977-a6ca-593a4e52bc3f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.387188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639868f3-688f-4977-a6ca-593a4e52bc3f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.387454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639868f3-688f-4977-a6ca-593a4e52bc3f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.388936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 508/994] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:34.394243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.394419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.394689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.415834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:34.417154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:34.435922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b8171-33b6-4120-9fe6-dc2a220eef56 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:34.472541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:34.473250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.473535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.473809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.474671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] RBAC: Adding query filter params (type=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:34.475124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:34.476512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:34.481966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 487/995] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:34 2022] GET /identity/v3/services?type=image => generated 123 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:34.507419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 509/996] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:34 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:34.529863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:34.607047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:34.667109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08f770-6bc5-4146-ac14-eb5f5d717ccf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:34.707442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:34.708669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.709242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.709736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.710600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:34.712321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:34.727705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:34.728783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:34.730275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:34.733200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 488/997] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:34.737568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:34.790772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:34.844923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456582cd-62cc-4bd8-89cd-32ea2ed6112f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:34.885170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:34.885796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:34.886071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:34.886342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:34.887055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:34.887353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:34.888738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628ff51-6244-4a8f-a63b-e715057aec07 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:34.899226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 510/998] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:34 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:34.900735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.014791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8daeaf-fb68-4a78-96b5-f932b971a8d9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.028807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d1076-95e8-41a2-a1e5-a98044d40533 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.029111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d1076-95e8-41a2-a1e5-a98044d40533 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.029392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d1076-95e8-41a2-a1e5-a98044d40533 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.031045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 511/999] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:35.036210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.036604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.036953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.046037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:35.057010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.057716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.057997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.058271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.058986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:35.059287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.060661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.061593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:35.063105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:35.066014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 489/1000] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:34 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:35.071835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.148692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 512/1001] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:35 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:35.170998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.202824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1d98-fc3b-4fc6-89d1-943bd68e9989 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.218029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:35.256137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.257149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.257596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.257991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.259214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] RBAC: Adding query filter params (interface=public, service_id=262edddb88df4790b7c13e7b5903c562, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:35.259690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.261859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.269497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 490/1002] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:35 2022] GET /identity/v3/endpoints?service_id=262edddb88df4790b7c13e7b5903c562&interface=public®ion_id=RegionOne => generated 195 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:35.277995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.282553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d403-6c9c-4303-a335-5a01d8a60434 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.326057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.327458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.328087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.328560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.329508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.331562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:35.346142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:35.347334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 19:06:35.348199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:35.349058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 513/1003] 10.222.0.113 () {56 vars in 1131 bytes} [Mon Jul 25 19:06:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:35.355386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.366857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:35.434145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78f4fe-3dbd-4dce-9673-ff7198dc6902 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.475261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.476039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.476335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.476597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.477313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.478707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.485847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 491/1004] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:35 2022] GET /identity/v3/services => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:06:35.489817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadca5e-ae66-475d-8daa-5bce59260438 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.499383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:35.551442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.552147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.552432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.552819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.553639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:35.553971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.555372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.562067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 514/1005] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:35 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:35.568461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.700898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff6716-7f0e-40e1-9338-99b442b8594d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.723402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:35.748638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.749619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.750036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.750433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.751496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:35.751946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.754059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705a924-6961-45f0-807f-938667ee2839 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.762735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 492/1006] 10.222.0.113 () {56 vars in 1127 bytes} [Mon Jul 25 19:06:35 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:35.771613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:35.893537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876900a-f04b-4b05-92a4-911a4451e607 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:35.927035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e97b28-f575-4a5d-b9e9-5cb5e5767b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:35.927858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e97b28-f575-4a5d-b9e9-5cb5e5767b9b None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:35.928150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e97b28-f575-4a5d-b9e9-5cb5e5767b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:35.928422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e97b28-f575-4a5d-b9e9-5cb5e5767b9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:35.929202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e97b28-f575-4a5d-b9e9-5cb5e5767b9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:35.930566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e97b28-f575-4a5d-b9e9-5cb5e5767b9b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:35.957248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 515/1007] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:36.561203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6657ce-0527-4f76-b205-758270b3bb8d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.561783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6657ce-0527-4f76-b205-758270b3bb8d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.561783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6657ce-0527-4f76-b205-758270b3bb8d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.563303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 493/1008] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:36.570415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066066-65e3-417c-b840-1381a19541c4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.570415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066066-65e3-417c-b840-1381a19541c4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.570415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b066066-65e3-417c-b840-1381a19541c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.595855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7b066066-65e3-417c-b840-1381a19541c4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:36.597810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7b066066-65e3-417c-b840-1381a19541c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:36.633578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.694814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 516/1009] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:36.716832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6657ce-0527-4f76-b205-758270b3bb8d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:36.836549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6657ce-0527-4f76-b205-758270b3bb8d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:36.873589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f89d9-61f6-45a9-b14c-ec112258523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:36.874653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f89d9-61f6-45a9-b14c-ec112258523c None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.875144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f89d9-61f6-45a9-b14c-ec112258523c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.875642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f89d9-61f6-45a9-b14c-ec112258523c None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.876603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f89d9-61f6-45a9-b14c-ec112258523c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:36.878214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f89d9-61f6-45a9-b14c-ec112258523c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:36.899735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 494/1010] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/services => generated 243 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:37.530484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe8733-197a-485b-b043-0622a32a24e6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.531045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe8733-197a-485b-b043-0622a32a24e6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.531045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe8733-197a-485b-b043-0622a32a24e6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.532439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 517/1011] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:37.538115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.538373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.538688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.557956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:37.559164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:37.597904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:37.642963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 495/1012] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:37 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:37.665692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe8733-197a-485b-b043-0622a32a24e6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.778455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe8733-197a-485b-b043-0622a32a24e6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.815237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.816044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.816326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.816593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.817272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.818741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:37.831675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:37.832707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:06:37.833607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:37.834931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 518/1013] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:37.837974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.946877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df7a7-d2cb-4269-b2bb-6a5e8e7bd70c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.981981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.982662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.982944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.983223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.983942 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:37.984249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.985670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd093-5dc6-45ca-8a22-4f188b3811c2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.991044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 496/1014] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:37 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:37.996646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:38.020151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:38.064529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96ba3-82fc-4e13-8e26-81a05eeb44fc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.064816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96ba3-82fc-4e13-8e26-81a05eeb44fc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.065100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96ba3-82fc-4e13-8e26-81a05eeb44fc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.066513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 497/1015] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:38.071645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.071936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.072226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.091827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:38.092823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:38.127053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:38.128101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0c00-812d-46f0-b914-b8476634ebdd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:38.175575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:38.176265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.176515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.176795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.177657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:38.178098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:38.179864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:38.185558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 519/1016] 10.222.0.113 () {56 vars in 1117 bytes} [Mon Jul 25 19:06:37 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:38.193188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 498/1017] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:38 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:38.195381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:38.213484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:38.304523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:38.323095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7e08-f905-4125-a2c2-2152265b1cb8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:38.345896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c18f9-d9a6-47d1-b369-5541022d06e4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:38.361563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:38.362228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.362506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.362781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.363536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:38.364955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:38.391289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 520/1018] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:38 2022] POST /identity/v3/endpoints => generated 336 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:38.403514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e512-c6cf-437a-b16a-2e4cc928a3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:38.404674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e512-c6cf-437a-b16a-2e4cc928a3bf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.405139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e512-c6cf-437a-b16a-2e4cc928a3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.405598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e512-c6cf-437a-b16a-2e4cc928a3bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.407312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e512-c6cf-437a-b16a-2e4cc928a3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:38.409079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e512-c6cf-437a-b16a-2e4cc928a3bf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:38.416302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 499/1019] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:38.417662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:38.546009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ffc48-f66e-4e74-b3da-4d4c5c3c731a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:38.583459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42123ed3-7993-4ce1-99ea-4c058aeea97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:38.584184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42123ed3-7993-4ce1-99ea-4c058aeea97e None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.584471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42123ed3-7993-4ce1-99ea-4c058aeea97e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.584752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42123ed3-7993-4ce1-99ea-4c058aeea97e None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.585532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42123ed3-7993-4ce1-99ea-4c058aeea97e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:38.587011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42123ed3-7993-4ce1-99ea-4c058aeea97e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:38.606847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:38.625250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 521/1020] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:06:38 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:38.966562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b43fd-0c90-4a12-b29f-3cbb706cebf6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.967111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b43fd-0c90-4a12-b29f-3cbb706cebf6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.967111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b43fd-0c90-4a12-b29f-3cbb706cebf6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.968446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 500/1021] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:38.974337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:38.974868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:38.974868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:38.994126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:38.995326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:39.069710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 522/1022] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:38 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:39.092232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b43fd-0c90-4a12-b29f-3cbb706cebf6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.121840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:39.201289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b43fd-0c90-4a12-b29f-3cbb706cebf6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.239986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.240824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.241111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.241416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.242079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:39.243465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:39.255401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:39.256749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:39.257688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 501/1023] 10.222.0.113 () {56 vars in 1110 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:39.263115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.371802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc061-5752-414b-ac42-9e1d9f7ef7a0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.406047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:39.426934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.427693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.427970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.428258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.428982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] RBAC: Adding query filter params (name=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:39.429318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:39.430720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:39.436141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 523/1024] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/services?name=image => generated 123 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:39.442057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.544695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:39.556185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2feccb-a390-4906-ac54-c8dfa2516bf2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.595509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.596446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.596928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.597385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.598245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] RBAC: Adding query filter params (type=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:39.598714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:39.600742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:39.607222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 502/1025] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/services?type=image => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:39.613483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.736309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cfd5c-05fd-4c9f-977f-5238532a876c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.772477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.773174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.773462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.773737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.774531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] RBAC: Adding query filter params (interface=public, service_id=9af8dc4468094846acb569656d506b4c, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:39.774845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:39.776244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fddb4a-1162-470b-85c5-97da5caf4ed3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:39.781834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 524/1026] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/endpoints?service_id=9af8dc4468094846acb569656d506b4c&interface=public®ion_id=RegionOne => generated 195 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:39.787878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.891822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d2eb6-60ae-4dba-bbbf-72dac359ce77 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.925661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b659aed-8069-407f-b094-742ecd7a6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.926384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b659aed-8069-407f-b094-742ecd7a6e1a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.926664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b659aed-8069-407f-b094-742ecd7a6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.926936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b659aed-8069-407f-b094-742ecd7a6e1a None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.927825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b659aed-8069-407f-b094-742ecd7a6e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:39.929465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b659aed-8069-407f-b094-742ecd7a6e1a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:39.936627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 503/1027] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/services => generated 1966 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:06:40.625007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04a15-8b0d-4ae8-91fc-f47bcdc45f05 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.625862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04a15-8b0d-4ae8-91fc-f47bcdc45f05 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.625862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04a15-8b0d-4ae8-91fc-f47bcdc45f05 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.626995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 525/1028] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:40.635760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.636264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.636603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.666236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:40.668189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:40.693309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.695746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08754f-03e2-481e-a270-6f188806586e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.695997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08754f-03e2-481e-a270-6f188806586e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.696387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08754f-03e2-481e-a270-6f188806586e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.698148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 526/1029] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:40.703457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.703793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.704006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.722751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:40.723957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:40.763080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 504/1030] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:40 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:40.777442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.786383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.802176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 527/1031] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:40 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:40.827078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.899786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5cec2-4f0b-4a40-91c5-30b5fbd843d6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.933895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a696-8cc3-4fac-93eb-080cbd45ff29 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.941014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.946050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.946050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.946050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.961457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:40.969794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:40.970834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:40.972318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 505/1032] 10.222.0.113 () {56 vars in 1125 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:40.977977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.986072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.986926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.987212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.987484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.988682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:40.990627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:40.992294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.997558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 528/1033] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:40.998434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.050244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.106867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad12301-be53-4818-8a4c-926221bc3b1a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.107169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b8d8d-f776-4c07-88c8-1aa4c0083c6f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.143678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.144374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.144653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.144925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.145681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.147565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.149300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.150086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.150257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.150517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.151267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:41.151569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.152928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.164138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 506/1034] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:41.169960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.181152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 529/1035] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:40 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:41.248531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.285326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4475b4f-a168-4129-9a0e-719266f8716b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.324544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.325395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.325676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.325947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.338924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.341059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:41.360153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:41.361146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:41.362078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:41.362078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:41.362078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:41.362078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:41.365220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 507/1036] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:41.367731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.480471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956601b7-2f45-4686-890e-895cc9e26205 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.483822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.520411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.521184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.521601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.522090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.522909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:41.523218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.524606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.542111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 530/1037] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:41.543776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.651833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f13c4-aae3-44be-8703-f9c8587d2964 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.675644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.689418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.690229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.690513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.690787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.699419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.700883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:41.718026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:41.719341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:41.720327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 508/1038] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:41.723669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.834780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531a0d-0cf1-47ce-ae0a-9934363250cf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.873641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.874322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.874597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.874866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.875697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:41.876002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.877462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21a68-bdee-4e30-9188-a95f9250769f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.895246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 531/1039] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:41.901260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.997273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a506c8-145a-4638-b1d2-79f2c9f1b04e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.997620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a506c8-145a-4638-b1d2-79f2c9f1b04e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.997838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a506c8-145a-4638-b1d2-79f2c9f1b04e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.999201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 532/1040] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:42.004487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.004772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.005047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.011218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635d0c-29f4-4f79-9b08-25fdfc9c1fd0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.024935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:42.026535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:42.045012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.052832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.053585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.053816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.054106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.105231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 533/1041] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:42 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:42.106740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.125552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.127223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.129725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.232169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf034868-ade9-46d5-a062-24d92e077ce3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.245591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 509/1042] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:42.251384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.273296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.274106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.274385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.274659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.275471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.276850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.289339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.290717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:42.291592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 534/1043] 10.222.0.113 () {56 vars in 1110 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:42.296836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.321448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.363176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.400228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142f538-7ba5-4424-83f4-159c4ed10369 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.441636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.443775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.443775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.443775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.453112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83491b3-14af-4dad-9a94-64d5d84c42e4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.454885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.457056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:42.475923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.476925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.477879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:42.477879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:42.477879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:42.477879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:42.477879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 510/1044] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:42.483397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.494219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.494900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.495179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.495459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.496175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] RBAC: Adding query filter params (name=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.496484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.497915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.503247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 535/1045] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/services?name=image => generated 123 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:42.509073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.601023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faffc67-76ab-4516-8471-06d75dd72fdf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.620584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.643195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d9ad3-45fc-4369-8077-ac7f45996c52 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.645168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.645854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.646331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.646954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.647461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.647770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.649214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.650920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.665180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 511/1046] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:42.670829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.702208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.703235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.703663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.704073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.705231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] RBAC: Adding query filter params (type=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.705714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.707902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.714968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 536/1047] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/services?type=image => generated 352 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:42.720914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.812724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a98516-65ca-4a0d-b26d-b8b19beb1bbb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.853515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.854530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.854816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.855106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.858203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a7b4-ff90-490d-87b8-407e51e7ec58 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.862464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.863949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:42.878985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.879936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:42.881588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 512/1048] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:42.886643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.897882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.898565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.898838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.899115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.899893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.901324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.919791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.937454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 537/1049] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:06:42 2022] POST /identity/v3/endpoints => generated 329 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:06:42.955636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.011846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1949b9-1839-412c-bf95-fba23c05a600 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.060825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.061569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.061853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.062127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.062974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.063285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.064807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9e13b-13e4-40b6-b25e-c9e697da2800 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.079698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 513/1050] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.085950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.201168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782bb3c-6a76-4246-8f9b-6c55c7115d9c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.239575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.240377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.240658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.240928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.241796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] RBAC: Adding query filter params (role.id=336029da93054d1d985ddc2f739d385e, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=15cfb6d527464ccaad7db841e3eacf7c) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.242108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.243582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0190c4-9c8f-4a7d-8988-dfece792b7d4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.252520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 538/1051] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/role_assignments?user.id=15cfb6d527464ccaad7db841e3eacf7c&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=336029da93054d1d985ddc2f739d385e => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.295335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b19fa-3e01-406c-bbdf-07ae5623fb2f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.295676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b19fa-3e01-406c-bbdf-07ae5623fb2f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.295863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b19fa-3e01-406c-bbdf-07ae5623fb2f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.297497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 514/1052] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:43.304146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.304401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.304677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.326439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:43.327688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:43.410115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.420423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 539/1053] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:43 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:43.446083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b19fa-3e01-406c-bbdf-07ae5623fb2f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.558541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b19fa-3e01-406c-bbdf-07ae5623fb2f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.570466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.595821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.596622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.596899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.597196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.608713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:43.616531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:43.617538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:43.618419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 515/1054] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:43.624003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.745951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a40d5-7873-45fa-a820-947f487c9b55 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.786827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.787534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.787812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.788066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.788834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.789151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.790546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.799719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 540/1055] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.805742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.924344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81eb3-4f57-4126-8216-12c2a56df638 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.960957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.961890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.962170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.962439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] PATH_INFO: `/v3/users/5cde14e911f14ffca753aea3d08218f3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.977066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] RBAC: Authorizing `identity:get_user(user_id=5cde14e911f14ffca753aea3d08218f3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.978642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.985783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 516/1056] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/users/5cde14e911f14ffca753aea3d08218f3 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.986815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.052435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.100539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a89e4-17ee-4c27-98d5-cbed97f540dc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.141502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.142165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.142446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.142723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.221199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.222623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.280000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.328951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 541/1057] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:44.334815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.371728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.458736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945536-e553-42d8-a880-6960f2e06d5f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.495681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98597f96-1b67-4446-89cc-e98cb70aa77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.496517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597f96-1b67-4446-89cc-e98cb70aa77e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.496921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597f96-1b67-4446-89cc-e98cb70aa77e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.497242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597f96-1b67-4446-89cc-e98cb70aa77e None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.498670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98597f96-1b67-4446-89cc-e98cb70aa77e None admin] RBAC: Authorizing `identity:get_project(project_id=561ffb06d8bd47668e52391de006563b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.500143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98597f96-1b67-4446-89cc-e98cb70aa77e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.507098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 517/1058] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/projects/561ffb06d8bd47668e52391de006563b => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:44.508435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.622956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddacce-5ef0-434e-b1a5-1a1ec5d59e18 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.658025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.658692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.658974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.659249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.660072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=561ffb06d8bd47668e52391de006563b, user.id=5cde14e911f14ffca753aea3d08218f3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:44.660394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.661918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ee8b-f9ac-449e-934f-706775ac70ad None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.669912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 542/1059] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/role_assignments?user.id=5cde14e911f14ffca753aea3d08218f3&scope.project.id=561ffb06d8bd47668e52391de006563b&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:45.058632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1510-3425-4d93-a25b-988f931347ba None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.059227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1510-3425-4d93-a25b-988f931347ba None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.059479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1510-3425-4d93-a25b-988f931347ba None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.061155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 518/1060] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:45.066937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd20-248f-405a-b0cc-f2576b05f265 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.067677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd20-248f-405a-b0cc-f2576b05f265 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.067677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd20-248f-405a-b0cc-f2576b05f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.087241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fbb3fd20-248f-405a-b0cc-f2576b05f265 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:45.088451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fbb3fd20-248f-405a-b0cc-f2576b05f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:45.105690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.169196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 543/1061] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:45 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:45.194321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1510-3425-4d93-a25b-988f931347ba None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.298920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.307445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1510-3425-4d93-a25b-988f931347ba None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.331830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b81ef0-3a37-410e-a7b5-6e0aae047eed None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.332167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b81ef0-3a37-410e-a7b5-6e0aae047eed None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.332387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b81ef0-3a37-410e-a7b5-6e0aae047eed None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.334591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 544/1062] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:45.339932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.340222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.340499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.358161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.358980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.359263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.359535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.359671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:45.360875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:45.445293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.447093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.460860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 545/1063] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:45 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:45.486479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.564900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.573877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 519/1064] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:45.580102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.582483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.603632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b6800-d990-439f-93f7-7e14eadb1358 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.640001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.640826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.641131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.641415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.653588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:45.661997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:45.662967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:45.663822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:45.668257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 546/1065] 10.222.0.113 () {56 vars in 1125 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:45.669346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.691797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0696800-15be-46d2-8da4-9ae90a2eb94f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.733100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.733931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.734213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.734636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.746485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.747966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:45.773449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:45.775108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:45.776801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:45.776801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:45.776801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:45.776801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:45.776801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 520/1066] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:45.782021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.785746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f98a1-e62e-43c5-848b-1f9b5138fcae None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.827836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.828535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.828821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.829099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.829890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.830200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.831596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.845669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 547/1067] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:45.846428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.849644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.864045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.926907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf83203-f3e3-407a-a118-4aba97fcc9aa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.956745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233ab4-ad0d-4616-9fc6-3c810e542087 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.965803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.966480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.966762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.967039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.967781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.968086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.969493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.982504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 521/1068] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:46.007133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.008032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.008313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.008575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.021903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.023476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:46.046508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:46.047540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:46.048475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:46.048475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:46.048475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:46.048475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:46.048475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 548/1069] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:46.057146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.173501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158b610-3a12-464d-b09a-03934a5f151d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.183791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.214509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.215631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.216106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.216563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.217875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:46.218419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.220869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.241311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 522/1070] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:46.250258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.315806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.362740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be097a6-8a67-4c28-a2b9-cac6286a167b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.404464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.405316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.405600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.405867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.414171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.415646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:46.431311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:46.432325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:46.433340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 549/1071] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:46.438473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.545306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd84d8-6f70-492a-b1f7-2e888c5ddabd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.581448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.582119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.582399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.582675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.583630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:46.584032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.585493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171c07b-52a5-411a-951f-c6b671d65d57 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.603920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 523/1072] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:46.610100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.670703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac52a-2021-4551-b1b1-889c84ed81d0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.671005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac52a-2021-4551-b1b1-889c84ed81d0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.671278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac52a-2021-4551-b1b1-889c84ed81d0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.672812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 524/1073] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:46.678143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.678441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.678741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.697504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:46.698662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:46.720567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.725447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ef49-865e-4caf-8b58-e1ba2454c0aa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.739967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.762026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.762839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.763126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.763405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.771410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 525/1074] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:06:46.774742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.776239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.794019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:46.794291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:46.796190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:46.798421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:46.798421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:46.798421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:46.798421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:46.798421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 550/1075] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:46.800987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.916448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1c292-cd8d-4d28-998b-763da2542eba None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.918830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5fcdb-c9de-4c26-95e2-0e7da928d70a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.953896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.954203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.954490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.954607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.954771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.954865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.955048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.955156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.955777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:46.956086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.957506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.970803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 551/1076] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:46.973087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:46.976622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:46.981507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:46.982510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:46.983361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 526/1077] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:46.988788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.012282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.014401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.088905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e9e92-32f6-490a-8c50-5d9ee0873db3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.097555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c7fb-8b99-4ff0-ba09-06d549be3a24 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.129676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.130549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.130837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.131119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.135435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.136107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.136388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.136661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.137639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:47.137943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.138169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.139341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.139634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.147901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 527/1078] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:47.153564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:47.154606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:47.156298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:47.157516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.157674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 552/1079] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:47.163044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.248399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.261144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.274555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc60143-f5f5-4ab7-a4ba-9dbfde9d0447 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.283033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2a757-fa40-42fa-8b87-99b67cf5996b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.312895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.313815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.314096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.314367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] PATH_INFO: `/v3/users/5cde14e911f14ffca753aea3d08218f3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.315572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] RBAC: Authorizing `identity:get_user(user_id=5cde14e911f14ffca753aea3d08218f3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.317023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.319346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.319479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 528/1080] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/users/5cde14e911f14ffca753aea3d08218f3 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:47.320086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.320443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.320695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.321515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:47.321820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.323249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.325045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.336344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 553/1081] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:47.342135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.434213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221339e-f25d-443f-a4f5-7f51555742b0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.446045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194e1ab-2476-4748-8fcd-75d523c6477f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.473778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.475269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.475558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.475839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.477166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] RBAC: Authorizing `identity:get_project(project_id=561ffb06d8bd47668e52391de006563b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.478672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.480756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 529/1082] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/projects/561ffb06d8bd47668e52391de006563b => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:47.482318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd078a97-6995-46c4-9da2-f76f8e7402e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.483225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd078a97-6995-46c4-9da2-f76f8e7402e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.483500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd078a97-6995-46c4-9da2-f76f8e7402e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.483766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd078a97-6995-46c4-9da2-f76f8e7402e0 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/15cfb6d527464ccaad7db841e3eacf7c/roles/336029da93054d1d985ddc2f739d385e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.486052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd078a97-6995-46c4-9da2-f76f8e7402e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=15cfb6d527464ccaad7db841e3eacf7c, role_id=336029da93054d1d985ddc2f739d385e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.486796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.487519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd078a97-6995-46c4-9da2-f76f8e7402e0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.504066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.504366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 554/1083] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:47 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/15cfb6d527464ccaad7db841e3eacf7c/roles/336029da93054d1d985ddc2f739d385e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:06:47.598939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2250b6-9607-46f2-840f-0a6828652d44 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.639193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea8fcb-a963-429f-9d06-4fe65581c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.640103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8fcb-a963-429f-9d06-4fe65581c3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.640390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8fcb-a963-429f-9d06-4fe65581c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.640659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8fcb-a963-429f-9d06-4fe65581c3d9 None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b/users/5cde14e911f14ffca753aea3d08218f3/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.642809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea8fcb-a963-429f-9d06-4fe65581c3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=561ffb06d8bd47668e52391de006563b, user_id=5cde14e911f14ffca753aea3d08218f3, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.644277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea8fcb-a963-429f-9d06-4fe65581c3d9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.660245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 530/1084] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:47 2022] PUT /identity/v3/projects/561ffb06d8bd47668e52391de006563b/users/5cde14e911f14ffca753aea3d08218f3/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:49.576968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeeeec-2ead-4ad9-9eee-568290017753 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.577669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeeeec-2ead-4ad9-9eee-568290017753 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.577669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeeeec-2ead-4ad9-9eee-568290017753 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.579248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 555/1085] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:49.585394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.585932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.586023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.606254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:49.607473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:49.672478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015274-debb-4959-9fd9-a249bd813f35 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.672761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015274-debb-4959-9fd9-a249bd813f35 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.673146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015274-debb-4959-9fd9-a249bd813f35 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.674630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 556/1086] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:49.680047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.680359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.680634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.684165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 531/1087] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:49.694404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.701262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:49.702662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:49.707959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.711851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.778508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 557/1088] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:49.802624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.818419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df0cb-9de8-4e37-9e1c-87f18535d9a3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.853429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.854570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.854864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.855124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.865699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:49.873989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:49.874983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:49.875820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 532/1089] 10.222.0.113 () {56 vars in 1125 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:49.881665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.941731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705726f0-85b3-42c7-93f4-27b259b795f5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.947395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.977738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.978544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.978822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.979444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.982336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.989190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648619e-84e3-44e7-996b-dc826e3badc3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.991363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:49.998996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.000141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:50.001289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 558/1090] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:50.006670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.029149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.029825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.030109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.030391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.031149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.031459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.032858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.041514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 533/1091] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:50.047230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.111864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733362-1366-4cd9-8fa4-8d5410aef367 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.147067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.147326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542456c-ceeb-45a8-b911-3e4cf3db7ab7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.147750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.148036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.148312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.149061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.149404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.150807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.159216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 559/1092] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.164968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.172734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.181755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.182618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.182855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.183128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.194500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.195905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:50.213762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.214750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.215655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:50.215655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:50.215655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.215655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:50.215655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 534/1093] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:50.221161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.225315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.273933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db378-20c6-4e7e-83d4-038c56697576 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.309184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.310085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.310369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.310649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] PATH_INFO: `/v3/users/5cde14e911f14ffca753aea3d08218f3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.311855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] RBAC: Authorizing `identity:get_user(user_id=5cde14e911f14ffca753aea3d08218f3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.313328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.315000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 560/1094] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/users/5cde14e911f14ffca753aea3d08218f3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.320862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.330188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4419ab-9c90-442f-84e7-3cd0030e2ba8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.365162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.365825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.366106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.366378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.367102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.367407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.368778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.382294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 535/1095] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.388175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.432095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b295e-3af1-48f0-be7e-51528c9a87ab None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.438773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.458376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.467584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.468251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.468540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.468815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.502384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b99f3-c039-4627-a650-9e8c11990f6c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.537935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.538152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.538748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.539031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.539306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.539395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.547283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.548746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:50.564164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.565720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:50.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:06:50.570588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 536/1096] 10.222.0.113 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:50.571413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.644071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 561/1097] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 19:06:50.650763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.670296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.675006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139ac8-e321-4f2d-84d2-669665d89cae None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.679780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.717870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.718470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.718755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.719032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.719885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.720197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.721675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.741107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 537/1098] 10.222.0.113 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.747071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.757290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2071a-2c82-4ed7-8b7b-33aad4a80cd6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.792850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.793756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.794039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.794309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.795509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] RBAC: Authorizing `identity:get_project(project_id=561ffb06d8bd47668e52391de006563b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.796955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.798905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 562/1099] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/projects/561ffb06d8bd47668e52391de006563b => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.805334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.863843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047aaad-0978-4ba5-938f-598fe39d3dca None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.902504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.903180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.903460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.903738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.905496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.913277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac51d9-82a4-4f1d-90cc-cc9211af8848 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.930076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.951804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.952472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.952753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.953028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.953897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=561ffb06d8bd47668e52391de006563b, user.id=5cde14e911f14ffca753aea3d08218f3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.954246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.955658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.961864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 563/1100] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/role_assignments?user.id=5cde14e911f14ffca753aea3d08218f3&scope.project.id=561ffb06d8bd47668e52391de006563b&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.974767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.975856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.088137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 538/1101] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 19:06:51.094263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.203152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f5616-27f2-43d2-9aad-a5f437057476 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.238972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.239989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.240186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.240461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.252051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.253546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:51.271190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:51.272233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:51.273669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:51.273669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:51.273669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:51.273669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:51.273669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 564/1102] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:51.278051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.336285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.383716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a913e31-2742-4b04-864f-691fb08316a1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.424432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.425134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.425434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.425739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.426477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.426783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.428227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.440361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 539/1103] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:51.446181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.460552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.555243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68e8a5-a688-4501-987e-29b84b4c2113 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.593805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.594617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.594895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.595166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.602954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.604738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:51.620261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:51.621296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:06:51.622202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 565/1104] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:51.627716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.751537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33e21-d8b7-4945-95f7-39b9169f0a5e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.768329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.787302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.787968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.788251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.788523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.789355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.789665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.791101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb651-6bc5-4eb5-8e6a-64ac975688f4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.803778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 540/1105] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:51.810194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.885957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.919672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207c70-f4a4-4773-a7f1-9f9282bdb7bf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.955024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.955684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.955969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.956244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.957079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] RBAC: Adding query filter params (role.id=336029da93054d1d985ddc2f739d385e, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=15cfb6d527464ccaad7db841e3eacf7c) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.957432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.958965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96150235-8cf1-4a04-b63d-41c00875f33d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.965098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 566/1106] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/role_assignments?user.id=15cfb6d527464ccaad7db841e3eacf7c&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=336029da93054d1d985ddc2f739d385e => generated 610 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:53.011550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094f09-dae3-4138-a224-27a53c5a30f8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.012378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094f09-dae3-4138-a224-27a53c5a30f8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.012522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094f09-dae3-4138-a224-27a53c5a30f8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.014715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 541/1107] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:53.023159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.023649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.023649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.041859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:53.043068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:53.121299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 567/1108] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:53.146541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094f09-dae3-4138-a224-27a53c5a30f8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.264334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094f09-dae3-4138-a224-27a53c5a30f8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.300454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eaf50-2b7c-4e41-bc7d-6ef758ad735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.301280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eaf50-2b7c-4e41-bc7d-6ef758ad735c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.301565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eaf50-2b7c-4e41-bc7d-6ef758ad735c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.302130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eaf50-2b7c-4e41-bc7d-6ef758ad735c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.303375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eaf50-2b7c-4e41-bc7d-6ef758ad735c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.304817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eaf50-2b7c-4e41-bc7d-6ef758ad735c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.306514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 542/1109] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:53 2022] GET /identity/v3/domains/default => generated 200 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:53.312489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.382352 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:53.420246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9292-d5c4-4255-81ab-252ca06ca044 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.454645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704259-e43c-4636-a908-a70042a409a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.455312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704259-e43c-4636-a908-a70042a409a7 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.455593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704259-e43c-4636-a908-a70042a409a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.455860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704259-e43c-4636-a908-a70042a409a7 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.456569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0704259-e43c-4636-a908-a70042a409a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.458040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0704259-e43c-4636-a908-a70042a409a7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.481992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 568/1110] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:53 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:55.499711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d7ac-4c5a-4d09-b375-f30db8230d61 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.500268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d7ac-4c5a-4d09-b375-f30db8230d61 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.500268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d7ac-4c5a-4d09-b375-f30db8230d61 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.501681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 543/1111] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:55.507565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.508058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.508158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.528477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:55.530809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:55.601663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 569/1112] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:55 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:55.626338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d7ac-4c5a-4d09-b375-f30db8230d61 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.683985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.752309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d7ac-4c5a-4d09-b375-f30db8230d61 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.788507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.789404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.789689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.789963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] PATH_INFO: `/v3/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.791487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] RBAC: Authorizing `identity:get_role(role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.792861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.794305 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 544/1113] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/roles/e339a6a40d554e1189338f7ed25eab3e => generated 224 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.800630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.865603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.920007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd7e6-189a-4bd5-9dfe-05a9185e2b63 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.956051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.956835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.957156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.957497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] PATH_INFO: `/v3/users/3d3165078d46418e9f9eb83c0c98a01d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.971704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] RBAC: Authorizing `identity:get_user(user_id=3d3165078d46418e9f9eb83c0c98a01d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.973158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.974997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 570/1114] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/users/3d3165078d46418e9f9eb83c0c98a01d => generated 287 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.981868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.095365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d341ff-b364-4172-9efc-5cb35a2ab3c3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.109761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.133615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.134423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.134709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.134983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.207858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:56.209482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:56.324523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 545/1115] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:06:56.330863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.447273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd785-c53d-4c42-8a58-0db700b51f7d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.460295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.487976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ceb49-08eb-4862-9999-400abd147f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.488845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ceb49-08eb-4862-9999-400abd147f2e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.489098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ceb49-08eb-4862-9999-400abd147f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.489481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ceb49-08eb-4862-9999-400abd147f2e None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.490732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ceb49-08eb-4862-9999-400abd147f2e None admin] RBAC: Authorizing `identity:get_project(project_id=561ffb06d8bd47668e52391de006563b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:56.492319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ceb49-08eb-4862-9999-400abd147f2e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:56.494132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 571/1116] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/projects/561ffb06d8bd47668e52391de006563b => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:56.500944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.516260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.608656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e204dc-9c8c-45bc-b178-73d411ddb5a6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.643711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.644401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.644685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.644958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.645893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] RBAC: Adding query filter params (role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=561ffb06d8bd47668e52391de006563b, user.id=3d3165078d46418e9f9eb83c0c98a01d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:56.646207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:56.647644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec7fba-e3fe-45e0-9f35-568ccf80a4ca None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:56.653902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 546/1117] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/role_assignments?user.id=3d3165078d46418e9f9eb83c0c98a01d&scope.project.id=561ffb06d8bd47668e52391de006563b&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:58.630852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc209f7-32d6-45c0-8c5b-6eb3159f4b4f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.631477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc209f7-32d6-45c0-8c5b-6eb3159f4b4f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.631477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc209f7-32d6-45c0-8c5b-6eb3159f4b4f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.632707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 572/1118] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:06:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:58.638305 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.638742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.638856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.661221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:58.662717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:58.737768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 547/1119] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:06:58.763407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc209f7-32d6-45c0-8c5b-6eb3159f4b4f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.879155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc209f7-32d6-45c0-8c5b-6eb3159f4b4f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.917568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.918355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.918639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.918889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] PATH_INFO: `/v3/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.920453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] RBAC: Authorizing `identity:get_role(role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.921873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.923287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 573/1120] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/roles/e339a6a40d554e1189338f7ed25eab3e => generated 224 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:58.929940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.938715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.044185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851f010-db6c-4685-9f30-2f3ee7d47aa0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.081540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.082435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.082717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.083132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] PATH_INFO: `/v3/users/3d3165078d46418e9f9eb83c0c98a01d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.084986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3165078d46418e9f9eb83c0c98a01d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.086473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.088159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 548/1121] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/users/3d3165078d46418e9f9eb83c0c98a01d => generated 287 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:59.094294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.144532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.204447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dce51-f8cb-4668-bb5f-a11269d99321 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.241058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daab298-8e18-49f5-869c-7b0fe2f107af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.241951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daab298-8e18-49f5-869c-7b0fe2f107af None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.242232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daab298-8e18-49f5-869c-7b0fe2f107af None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.242503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daab298-8e18-49f5-869c-7b0fe2f107af None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.243740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daab298-8e18-49f5-869c-7b0fe2f107af None admin] RBAC: Authorizing `identity:get_project(project_id=561ffb06d8bd47668e52391de006563b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.245187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daab298-8e18-49f5-869c-7b0fe2f107af None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.246935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 574/1122] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/projects/561ffb06d8bd47668e52391de006563b => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:59.253334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.341431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.374351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444482c0-2057-45df-9c8d-0334e2c91413 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.411934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab2e3-c5f5-4ba2-946e-135f57d0801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.412840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab2e3-c5f5-4ba2-946e-135f57d0801a None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.413151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab2e3-c5f5-4ba2-946e-135f57d0801a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.413439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab2e3-c5f5-4ba2-946e-135f57d0801a None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b/users/3d3165078d46418e9f9eb83c0c98a01d/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.415795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab2e3-c5f5-4ba2-946e-135f57d0801a None admin] RBAC: Authorizing `identity:create_grant(project_id=561ffb06d8bd47668e52391de006563b, user_id=3d3165078d46418e9f9eb83c0c98a01d, role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.417271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab2e3-c5f5-4ba2-946e-135f57d0801a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.432936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 549/1123] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:59 2022] PUT /identity/v3/projects/561ffb06d8bd47668e52391de006563b/users/3d3165078d46418e9f9eb83c0c98a01d/roles/e339a6a40d554e1189338f7ed25eab3e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:07:01.428236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097be81-bbf6-41c2-b804-810da1051feb None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.428794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097be81-bbf6-41c2-b804-810da1051feb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.428794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097be81-bbf6-41c2-b804-810da1051feb None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.430195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 575/1124] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:01.436016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.436480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.436570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.456462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:01.457688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:01.530661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 550/1125] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:01.555644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097be81-bbf6-41c2-b804-810da1051feb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:01.671283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097be81-bbf6-41c2-b804-810da1051feb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:01.686201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:01.711544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:01.712415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.712694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.712965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] PATH_INFO: `/v3/roles/e339a6a40d554e1189338f7ed25eab3e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.714543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] RBAC: Authorizing `identity:get_role(role_id=e339a6a40d554e1189338f7ed25eab3e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:01.715935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:01.717408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 576/1126] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:01 2022] GET /identity/v3/roles/e339a6a40d554e1189338f7ed25eab3e => generated 224 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:01.723880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:01.805639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:01.855906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae064a1-02f5-44ae-ad74-38038e1dec29 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:01.895907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:01.896793 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.897073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.897379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] PATH_INFO: `/v3/users/3d3165078d46418e9f9eb83c0c98a01d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.898657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3165078d46418e9f9eb83c0c98a01d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:01.900113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:01.901816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 551/1127] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:01 2022] GET /identity/v3/users/3d3165078d46418e9f9eb83c0c98a01d => generated 287 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:01.908072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:02.025162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7ffd8-f078-4f42-92e6-afcd141f0f6b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:02.066311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:02.067024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.067755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.067755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.120543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:02.142205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:02.143673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:02.248968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 577/1128] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:01 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:02.255990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:02.375866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668568c-6e69-4527-ad87-c9047456e350 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:02.407719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:02.413761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cbff6-fcd6-49f8-9d92-cf3a181f5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:02.414643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbff6-fcd6-49f8-9d92-cf3a181f5290 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.414931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbff6-fcd6-49f8-9d92-cf3a181f5290 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.415209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbff6-fcd6-49f8-9d92-cf3a181f5290 None admin] PATH_INFO: `/v3/projects/561ffb06d8bd47668e52391de006563b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.416469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cbff6-fcd6-49f8-9d92-cf3a181f5290 None admin] RBAC: Authorizing `identity:get_project(project_id=561ffb06d8bd47668e52391de006563b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:02.417962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cbff6-fcd6-49f8-9d92-cf3a181f5290 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:02.419706 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 552/1129] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:02 2022] GET /identity/v3/projects/561ffb06d8bd47668e52391de006563b => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:02.426346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:02.523612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:02.544801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a874-5578-4c48-97ad-d7e1c49fbe57 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:02.582178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:02.582904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.583184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.583460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.584294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] RBAC: Adding query filter params (role.id=e339a6a40d554e1189338f7ed25eab3e, scope.project.id=561ffb06d8bd47668e52391de006563b, user.id=3d3165078d46418e9f9eb83c0c98a01d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:02.584607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:02.586057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206898c4-b5a3-4abd-a3bf-2c22c3200eaa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:02.593525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 578/1130] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:02 2022] GET /identity/v3/role_assignments?user.id=3d3165078d46418e9f9eb83c0c98a01d&scope.project.id=561ffb06d8bd47668e52391de006563b&role.id=e339a6a40d554e1189338f7ed25eab3e => generated 610 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:04.674984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dfc1f-318d-440a-8d6e-9c1ecab40c2f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.675509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dfc1f-318d-440a-8d6e-9c1ecab40c2f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.675509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dfc1f-318d-440a-8d6e-9c1ecab40c2f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.676882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 553/1131] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:04.682685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.683202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.683202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.702584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:04.703805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:04.781923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 579/1132] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:04 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:04.807344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dfc1f-318d-440a-8d6e-9c1ecab40c2f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.931683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dfc1f-318d-440a-8d6e-9c1ecab40c2f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.974680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8d337-3b29-4d4d-8bd9-bc04ef6ef02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.975507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8d337-3b29-4d4d-8bd9-bc04ef6ef02c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.975792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8d337-3b29-4d4d-8bd9-bc04ef6ef02c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.976067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8d337-3b29-4d4d-8bd9-bc04ef6ef02c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.977330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8d337-3b29-4d4d-8bd9-bc04ef6ef02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.979089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8d337-3b29-4d4d-8bd9-bc04ef6ef02c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.980749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 554/1133] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:04.987462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:05.072995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:05.099921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1379-4f05-4494-98ec-7dd7c8e31b4a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:05.137252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9de3a-69f4-4498-8ac7-7039f4b0f151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:05.137932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9de3a-69f4-4498-8ac7-7039f4b0f151 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.138184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9de3a-69f4-4498-8ac7-7039f4b0f151 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.138486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9de3a-69f4-4498-8ac7-7039f4b0f151 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.139183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9de3a-69f4-4498-8ac7-7039f4b0f151 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:05.140633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9de3a-69f4-4498-8ac7-7039f4b0f151 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:05.169428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 580/1134] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:04 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:07.299650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc32f5-8e77-4df4-a8a6-6bb4b3d1e2bf None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.300236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc32f5-8e77-4df4-a8a6-6bb4b3d1e2bf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.300236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc32f5-8e77-4df4-a8a6-6bb4b3d1e2bf None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.302322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 555/1135] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:07.308359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.308891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.308891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.329779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:07.330984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:07.412273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 581/1136] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:07 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:07.438182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc32f5-8e77-4df4-a8a6-6bb4b3d1e2bf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:07.513334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:07.549501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc32f5-8e77-4df4-a8a6-6bb4b3d1e2bf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:07.586957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5566928-9e0a-4ea4-8d53-b658a380295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:07.587751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5566928-9e0a-4ea4-8d53-b658a380295a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.588034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5566928-9e0a-4ea4-8d53-b658a380295a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.588288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5566928-9e0a-4ea4-8d53-b658a380295a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.589544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5566928-9e0a-4ea4-8d53-b658a380295a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:07.590984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5566928-9e0a-4ea4-8d53-b658a380295a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:07.592678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 556/1137] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:07.600515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:07.663028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:07.710349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12379-9b7c-4488-9d75-adf1fd5f5eef None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:07.749726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858da2-a393-4179-b230-86e2f5d80180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:07.750411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858da2-a393-4179-b230-86e2f5d80180 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.750689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858da2-a393-4179-b230-86e2f5d80180 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.750959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858da2-a393-4179-b230-86e2f5d80180 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.751673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858da2-a393-4179-b230-86e2f5d80180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:07.753165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858da2-a393-4179-b230-86e2f5d80180 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:07.776989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 582/1138] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:07:07 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:09.871326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5b28-e190-4f5f-aadb-d5ce8c667ffc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.871902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5b28-e190-4f5f-aadb-d5ce8c667ffc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.871902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5b28-e190-4f5f-aadb-d5ce8c667ffc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.873292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 557/1139] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:09.879070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.879672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.880295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.898081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:09.899294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:09.978429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 583/1140] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:09 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:10.003245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa5b28-e190-4f5f-aadb-d5ce8c667ffc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.130820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa5b28-e190-4f5f-aadb-d5ce8c667ffc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.168162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.168972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.169298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.169576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.172635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.184208 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:10.192059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:10.193227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:07:10.194199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 558/1141] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:10.199917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.254317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.315874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4ac57-938c-44b2-9060-b0ee2454c4f1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.352504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.353174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.353484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.354063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.354820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:10.355120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.356510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.367292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 584/1142] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:10.373460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.487847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77315-4847-4466-ac94-2de8e1d240ec None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.524881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.525789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.526066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.526346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] PATH_INFO: `/v3/users/adbde54af35b4b5b9e182511eee3a86a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.541950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] RBAC: Authorizing `identity:get_user(user_id=adbde54af35b4b5b9e182511eee3a86a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.543416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.545168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 559/1143] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/users/adbde54af35b4b5b9e182511eee3a86a => generated 287 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:10.551461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.681977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc735b4-427a-456a-a8af-ee631233ccb2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.684568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.719858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.720515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.720800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.721074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.800099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.801802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.916097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 585/1144] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:10.925636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.992834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.041240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da007f-f55d-4e0b-b466-e7119f939e31 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.077890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8a246-860b-47de-be49-c7ab7af0979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.078758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8a246-860b-47de-be49-c7ab7af0979b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.079040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8a246-860b-47de-be49-c7ab7af0979b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.079316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8a246-860b-47de-be49-c7ab7af0979b None admin] PATH_INFO: `/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.080578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8a246-860b-47de-be49-c7ab7af0979b None admin] RBAC: Authorizing `identity:get_project(project_id=a4dc5a1d0cf74839a0ebd7214f1fbdf0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.082057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8a246-860b-47de-be49-c7ab7af0979b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.084080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 560/1145] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:11.090619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.094257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.202943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7d012-379c-42ce-9aa3-56b640da3c4b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.240837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.241507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.241778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.242046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.242915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=a4dc5a1d0cf74839a0ebd7214f1fbdf0, user.id=adbde54af35b4b5b9e182511eee3a86a) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:11.243217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.244660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53de3f0-8126-4d7b-aa96-480a33ab948a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.251046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 586/1146] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/role_assignments?user.id=adbde54af35b4b5b9e182511eee3a86a&scope.project.id=a4dc5a1d0cf74839a0ebd7214f1fbdf0&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:13.263452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b83b6-33d0-42a5-b5e6-163e0eb13b4c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.264366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b83b6-33d0-42a5-b5e6-163e0eb13b4c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.264366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b83b6-33d0-42a5-b5e6-163e0eb13b4c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.266444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 561/1147] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:13.273249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.273739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.273842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.293634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:13.294857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:13.371121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:13.377748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 587/1148] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:13.401300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b83b6-33d0-42a5-b5e6-163e0eb13b4c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:13.521513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b83b6-33d0-42a5-b5e6-163e0eb13b4c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:13.545869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:13.559527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:13.560335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.560616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.560896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.573536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:13.581226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:13.582487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:07:13.583406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 562/1149] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:13.592095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:13.709626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9f18-6a83-4b4b-b98b-f5be6adcac36 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:13.747112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:13.747775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.748060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.748331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.749083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:13.749429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:13.750821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:13.760034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 588/1150] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:13.766443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:13.890058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0eb03-0816-4581-b70e-55c5c2cfff98 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:13.931419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:13.932304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.932561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.932839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] PATH_INFO: `/v3/users/adbde54af35b4b5b9e182511eee3a86a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.934187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] RBAC: Authorizing `identity:get_user(user_id=adbde54af35b4b5b9e182511eee3a86a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:13.935636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:13.937359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 563/1151] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:13 2022] GET /identity/v3/users/adbde54af35b4b5b9e182511eee3a86a => generated 287 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:13.944361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:14.012765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:14.058777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2bda4-d36f-4ce6-9805-cb6a57138c94 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:14.095982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02249242-cdcd-4dac-b5aa-3fb5d8c00b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:14.096858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02249242-cdcd-4dac-b5aa-3fb5d8c00b2e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:14.097163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02249242-cdcd-4dac-b5aa-3fb5d8c00b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:14.097429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02249242-cdcd-4dac-b5aa-3fb5d8c00b2e None admin] PATH_INFO: `/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:14.099121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02249242-cdcd-4dac-b5aa-3fb5d8c00b2e None admin] RBAC: Authorizing `identity:get_project(project_id=a4dc5a1d0cf74839a0ebd7214f1fbdf0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:14.100588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02249242-cdcd-4dac-b5aa-3fb5d8c00b2e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:14.102403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 589/1152] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:13 2022] GET /identity/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:14.109250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:14.169569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:14.227439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ffd35-d259-4a5d-a220-72ddc0a8b552 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:14.262881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b4b3-0627-471d-a612-0b13500f9dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:14.263782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b4b3-0627-471d-a612-0b13500f9dbe None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:14.264333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b4b3-0627-471d-a612-0b13500f9dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:14.264333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b4b3-0627-471d-a612-0b13500f9dbe None admin] PATH_INFO: `/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0/users/adbde54af35b4b5b9e182511eee3a86a/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:14.266328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b4b3-0627-471d-a612-0b13500f9dbe None admin] RBAC: Authorizing `identity:create_grant(project_id=a4dc5a1d0cf74839a0ebd7214f1fbdf0, user_id=adbde54af35b4b5b9e182511eee3a86a, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:14.267809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b4b3-0627-471d-a612-0b13500f9dbe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:14.282454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 564/1153] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:07:14 2022] PUT /identity/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0/users/adbde54af35b4b5b9e182511eee3a86a/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:07:16.302770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a1271-c433-46df-95bf-2040a8d37465 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.303334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a1271-c433-46df-95bf-2040a8d37465 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.303334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a1271-c433-46df-95bf-2040a8d37465 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.304694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 590/1154] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:16.311093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.311712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.311834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.335139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:16.336372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:16.435195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 565/1155] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:16.461969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a1271-c433-46df-95bf-2040a8d37465 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.578825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a1271-c433-46df-95bf-2040a8d37465 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.607949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.619765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.620981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.621483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.621781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.635128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:16.642837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:16.643912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:07:16.644789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 591/1156] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:16.651299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.696065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.776899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f256b2-e3b4-4fea-b34b-b8b5480837e4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.818189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.818860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.819143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.819424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.820183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:16.820489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:16.821882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:16.830917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 566/1157] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:16.837547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.957954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907392d-462e-4da1-a9ba-1ec54cb2d720 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.000592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.000955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.001259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.001534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] PATH_INFO: `/v3/users/adbde54af35b4b5b9e182511eee3a86a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.002894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] RBAC: Authorizing `identity:get_user(user_id=adbde54af35b4b5b9e182511eee3a86a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.004989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.006727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 592/1158] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/users/adbde54af35b4b5b9e182511eee3a86a => generated 287 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:17.012862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.123285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83538aba-bd4a-4b8b-bc0d-6baa917a4e41 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.124949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.166033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.166693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.166980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.167255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.242312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.243785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.354805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 567/1159] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:17.361463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.426336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.477499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346ef1b-2b7d-4b77-af15-e48fe1abd430 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.514496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6631cb-21ca-4e61-bd41-25edfdbde83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.515384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6631cb-21ca-4e61-bd41-25edfdbde83b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.515668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6631cb-21ca-4e61-bd41-25edfdbde83b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.515942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6631cb-21ca-4e61-bd41-25edfdbde83b None admin] PATH_INFO: `/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.517336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6631cb-21ca-4e61-bd41-25edfdbde83b None admin] RBAC: Authorizing `identity:get_project(project_id=a4dc5a1d0cf74839a0ebd7214f1fbdf0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.518825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6631cb-21ca-4e61-bd41-25edfdbde83b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.520636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 593/1160] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/projects/a4dc5a1d0cf74839a0ebd7214f1fbdf0 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:17.527125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.529579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.637310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05e1f-0c76-4bda-8c5a-bea7318a5fb4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.676246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.677009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.677317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.677596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.678430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=a4dc5a1d0cf74839a0ebd7214f1fbdf0, user.id=adbde54af35b4b5b9e182511eee3a86a) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:17.678742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.680175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70db558-afd1-47c2-9778-1ad371d3937f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.686705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 568/1161] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/role_assignments?user.id=adbde54af35b4b5b9e182511eee3a86a&scope.project.id=a4dc5a1d0cf74839a0ebd7214f1fbdf0&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:19.773987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ee4e9-5b70-4829-804b-48f848c71224 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:19.774536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ee4e9-5b70-4829-804b-48f848c71224 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:19.774536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ee4e9-5b70-4829-804b-48f848c71224 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:19.775784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 594/1162] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:19.782681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533d450-4172-440e-aef7-499e533adb02 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:19.783315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533d450-4172-440e-aef7-499e533adb02 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:19.783637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533d450-4172-440e-aef7-499e533adb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:19.805885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d533d450-4172-440e-aef7-499e533adb02 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:19.807672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d533d450-4172-440e-aef7-499e533adb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:19.876972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:19.885593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 569/1163] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:19.907349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ee4e9-5b70-4829-804b-48f848c71224 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:20.029095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ee4e9-5b70-4829-804b-48f848c71224 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:20.055387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:20.068868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:20.069888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:20.070334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:20.070778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:20.149830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:20.151292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:20.260951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 595/1164] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:19 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:20.267321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533d450-4172-440e-aef7-499e533adb02 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:20.382032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533d450-4172-440e-aef7-499e533adb02 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:20.420467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:20.421318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:20.421601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:20.421873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:20.430283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:20.431732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c61c37e1-7e41-4c14-8859-8ae347dc2a7a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:20.447146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:20.448420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:07:20.449347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 570/1165] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:07:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:20.454750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:20.482044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:20.568786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a56bb-44ab-41a3-9c37-96e9b0599050 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:20.608904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:20.609612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:20.609896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:20.610167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:20.610897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:20.611176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:20.612614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d5668-40b6-48c1-8671-6f34be13c66e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:20.621148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 596/1166] 10.222.0.113 () {56 vars in 1120 bytes} [Mon Jul 25 19:07:20 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:22.618758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d156-b3ca-4f9c-b6e4-2e2961cb0c8b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.619334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d156-b3ca-4f9c-b6e4-2e2961cb0c8b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.619334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d156-b3ca-4f9c-b6e4-2e2961cb0c8b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.620688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 571/1167] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:22.626227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088addc7-db2a-4b8a-821a-6a3fc376c76b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.626711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088addc7-db2a-4b8a-821a-6a3fc376c76b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.626808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088addc7-db2a-4b8a-821a-6a3fc376c76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.646866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-088addc7-db2a-4b8a-821a-6a3fc376c76b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:22.647981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-088addc7-db2a-4b8a-821a-6a3fc376c76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:22.718311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 597/1168] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:22.742429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d156-b3ca-4f9c-b6e4-2e2961cb0c8b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:22.810714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:22.859583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d156-b3ca-4f9c-b6e4-2e2961cb0c8b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:22.896591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3578d3-4aee-4fb4-ab17-bdf9ec2d3bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:22.897348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3578d3-4aee-4fb4-ab17-bdf9ec2d3bec None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.897534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3578d3-4aee-4fb4-ab17-bdf9ec2d3bec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.897881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3578d3-4aee-4fb4-ab17-bdf9ec2d3bec None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.898625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3578d3-4aee-4fb4-ab17-bdf9ec2d3bec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:22.900012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3578d3-4aee-4fb4-ab17-bdf9ec2d3bec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:22.925275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 572/1169] 10.222.0.113 () {60 vars in 1143 bytes} [Mon Jul 25 19:07:22 2022] POST /identity/v3/domains => generated 268 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:24.942218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ba90-9b51-4590-98a6-13f15ca01f4b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:24.942806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ba90-9b51-4590-98a6-13f15ca01f4b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:24.942806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ba90-9b51-4590-98a6-13f15ca01f4b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:24.944644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 598/1170] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:24.950999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:24.951523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:24.951523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:24.970801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:24.972409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:25.043103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 573/1171] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:25.067272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ba90-9b51-4590-98a6-13f15ca01f4b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:25.096279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:25.198413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ba90-9b51-4590-98a6-13f15ca01f4b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:25.237777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcd4b-7fd7-45cf-ad01-2314b8a4b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:25.238911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcd4b-7fd7-45cf-ad01-2314b8a4b76f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:25.239194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcd4b-7fd7-45cf-ad01-2314b8a4b76f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:25.239473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcd4b-7fd7-45cf-ad01-2314b8a4b76f None admin] PATH_INFO: `/v3/domains/4d2f78a186924366b94365b99b2b22e2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:25.251374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcd4b-7fd7-45cf-ad01-2314b8a4b76f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d2f78a186924366b94365b99b2b22e2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:25.252879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcd4b-7fd7-45cf-ad01-2314b8a4b76f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:25.254833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 599/1172] 10.222.0.113 () {56 vars in 1188 bytes} [Mon Jul 25 19:07:25 2022] GET /identity/v3/domains/4d2f78a186924366b94365b99b2b22e2 => generated 268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:25.261036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:25.317510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:25.376423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d057d-83d3-4c7c-bc3e-b3d68f50d5a6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:25.426737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb64cb-fca6-4fc3-a602-e38f0765e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:25.427416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb64cb-fca6-4fc3-a602-e38f0765e076 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:25.427695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb64cb-fca6-4fc3-a602-e38f0765e076 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:25.427964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb64cb-fca6-4fc3-a602-e38f0765e076 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:25.428688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb64cb-fca6-4fc3-a602-e38f0765e076 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:25.430169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb64cb-fca6-4fc3-a602-e38f0765e076 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:25.462939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 574/1173] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:25 2022] POST /identity/v3/projects => generated 362 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:27.508471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffa2dc-8cea-4a49-8ec5-693f2a803d72 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.509024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffa2dc-8cea-4a49-8ec5-693f2a803d72 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.509024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffa2dc-8cea-4a49-8ec5-693f2a803d72 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.510670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 600/1174] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:27.516550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.517019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.517155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.537556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:27.538770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:27.613142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 575/1175] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:27 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:27.642095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffa2dc-8cea-4a49-8ec5-693f2a803d72 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:27.731295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:27.756366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffa2dc-8cea-4a49-8ec5-693f2a803d72 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:27.793229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdcd4e-90be-40f8-b6c3-ea3c375990fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:27.794115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdcd4e-90be-40f8-b6c3-ea3c375990fc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.794395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdcd4e-90be-40f8-b6c3-ea3c375990fc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.794666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdcd4e-90be-40f8-b6c3-ea3c375990fc None admin] PATH_INFO: `/v3/domains/4d2f78a186924366b94365b99b2b22e2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.795911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdcd4e-90be-40f8-b6c3-ea3c375990fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d2f78a186924366b94365b99b2b22e2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:27.797411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdcd4e-90be-40f8-b6c3-ea3c375990fc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:27.799061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 601/1176] 10.222.0.113 () {56 vars in 1188 bytes} [Mon Jul 25 19:07:27 2022] GET /identity/v3/domains/4d2f78a186924366b94365b99b2b22e2 => generated 268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:27.805500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:27.833978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:27.913534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79e75-55cf-4989-8ffd-ea412af82c84 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:27.950337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78d066-c309-41d0-8252-c5388c8da427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:27.951017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d066-c309-41d0-8252-c5388c8da427 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.951407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d066-c309-41d0-8252-c5388c8da427 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.951698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78d066-c309-41d0-8252-c5388c8da427 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.952420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78d066-c309-41d0-8252-c5388c8da427 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:27.953906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78d066-c309-41d0-8252-c5388c8da427 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:27.977004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 576/1177] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:07:27 2022] POST /identity/v3/users => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:30.091701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98506-2c7d-4b27-9372-495dfef4c6fd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.092261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98506-2c7d-4b27-9372-495dfef4c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.092261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98506-2c7d-4b27-9372-495dfef4c6fd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.093693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 602/1178] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:30.099890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.100349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.100439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.120941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:30.122179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:30.204528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 577/1179] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:30.228041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98506-2c7d-4b27-9372-495dfef4c6fd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.346225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98506-2c7d-4b27-9372-495dfef4c6fd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.387661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.388767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.389208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.389537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.402687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:30.413173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:30.414216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:07:30.415320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 603/1180] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:30.420890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.437458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.530418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6815-026c-4b34-b61a-55c90fe464bf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.566742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.567409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.567700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.567940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.568778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:30.569084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:30.570499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:30.580511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 578/1181] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:30.587213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.599700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.703081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1a0c-4348-4bfe-ab63-99de83c2480e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.742790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.743682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.743963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.744242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] PATH_INFO: `/v3/users/8cb6dba624554d30afc164f65d6c2d25` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.758630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] RBAC: Authorizing `identity:get_user(user_id=8cb6dba624554d30afc164f65d6c2d25)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:30.760078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:30.761922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 604/1182] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:30 2022] GET /identity/v3/users/8cb6dba624554d30afc164f65d6c2d25 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:30.768040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.851189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.877151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4123a3-d50a-41ce-a5ad-0225f9e7b443 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.920004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.920962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.921422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.921842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.006237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:31.007699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:31.087811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:31.115434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 579/1183] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:30 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:31.121685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:31.198527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:31.239975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29f752-02e7-42f3-8ea9-7194e1644164 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:31.278364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804d176-e816-416c-9230-b3bf33e51a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:31.279233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804d176-e816-416c-9230-b3bf33e51a66 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.279508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804d176-e816-416c-9230-b3bf33e51a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.279776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804d176-e816-416c-9230-b3bf33e51a66 None admin] PATH_INFO: `/v3/projects/6fa329a69b57419592188293a97debe6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.280971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804d176-e816-416c-9230-b3bf33e51a66 None admin] RBAC: Authorizing `identity:get_project(project_id=6fa329a69b57419592188293a97debe6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:31.282440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804d176-e816-416c-9230-b3bf33e51a66 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:31.284176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 605/1184] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:31 2022] GET /identity/v3/projects/6fa329a69b57419592188293a97debe6 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:31.291294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:31.402440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d4e87-93a5-433e-99aa-b5544a444473 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:31.438988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:31.439667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.439950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.440223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.441086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=6fa329a69b57419592188293a97debe6, user.id=8cb6dba624554d30afc164f65d6c2d25) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:31.441499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:31.442959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe789fa-b6cc-4f18-8319-07a455c603a7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:31.448842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 580/1185] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:31 2022] GET /identity/v3/role_assignments?user.id=8cb6dba624554d30afc164f65d6c2d25&scope.project.id=6fa329a69b57419592188293a97debe6&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:33.523828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f41d7-d603-4c38-a973-c26b9658814d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.524386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f41d7-d603-4c38-a973-c26b9658814d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.524386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f41d7-d603-4c38-a973-c26b9658814d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.526358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 606/1186] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:33.532292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.532804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.532896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.561684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:33.563606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:33.608036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:33.652320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 581/1187] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:33 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:33.681543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f41d7-d603-4c38-a973-c26b9658814d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:33.812497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f41d7-d603-4c38-a973-c26b9658814d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:33.858540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:33.866615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:33.867442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.867728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.868002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.879404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:33.887138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:33.888328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:07:33.889282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 607/1188] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:33.894831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:34.029299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a908-a648-4651-97e0-6d2162eb1f91 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:34.081050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:34.082015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.082304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.082586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.083363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:34.083675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:34.085064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:34.096213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 582/1189] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:34.106400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:34.253987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c43cc-b0b2-41a1-883c-b80330b2782f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:34.297992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:34.298792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.299068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.299334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] PATH_INFO: `/v3/users/8cb6dba624554d30afc164f65d6c2d25` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.300868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] RBAC: Authorizing `identity:get_user(user_id=8cb6dba624554d30afc164f65d6c2d25)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:34.302357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:34.304337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 608/1190] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:34 2022] GET /identity/v3/users/8cb6dba624554d30afc164f65d6c2d25 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:34.311060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:34.355654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:34.433775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34e69-6e97-4cbb-8004-1940b0200387 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:34.471894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950fc0-6621-464d-be77-2733a42d34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:34.472870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950fc0-6621-464d-be77-2733a42d34ab None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.473157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950fc0-6621-464d-be77-2733a42d34ab None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.473444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950fc0-6621-464d-be77-2733a42d34ab None admin] PATH_INFO: `/v3/projects/6fa329a69b57419592188293a97debe6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.474720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1950fc0-6621-464d-be77-2733a42d34ab None admin] RBAC: Authorizing `identity:get_project(project_id=6fa329a69b57419592188293a97debe6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:34.476173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1950fc0-6621-464d-be77-2733a42d34ab None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:34.478487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 583/1191] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:34 2022] GET /identity/v3/projects/6fa329a69b57419592188293a97debe6 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:34.484855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:34.562726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:34.633745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587bf54-6e5a-4ecb-8dbb-77a2028d778c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:34.682944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe495-8d61-48eb-9bb4-c88a1f0a74bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:34.684529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe495-8d61-48eb-9bb4-c88a1f0a74bb None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.685048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe495-8d61-48eb-9bb4-c88a1f0a74bb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.685516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe495-8d61-48eb-9bb4-c88a1f0a74bb None admin] PATH_INFO: `/v3/projects/6fa329a69b57419592188293a97debe6/users/8cb6dba624554d30afc164f65d6c2d25/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.689178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe495-8d61-48eb-9bb4-c88a1f0a74bb None admin] RBAC: Authorizing `identity:create_grant(project_id=6fa329a69b57419592188293a97debe6, user_id=8cb6dba624554d30afc164f65d6c2d25, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:34.691820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe495-8d61-48eb-9bb4-c88a1f0a74bb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:34.711604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 609/1192] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:07:34 2022] PUT /identity/v3/projects/6fa329a69b57419592188293a97debe6/users/8cb6dba624554d30afc164f65d6c2d25/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:07:36.809176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be1bf2-306d-4b93-a25f-5b65a13ec02c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:36.809714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be1bf2-306d-4b93-a25f-5b65a13ec02c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:36.809714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be1bf2-306d-4b93-a25f-5b65a13ec02c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:36.812083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 584/1193] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:07:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:36.818120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:36.818627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:36.818726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:36.841322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:36.842566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:36.924259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 610/1194] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:36 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:36.947937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be1bf2-306d-4b93-a25f-5b65a13ec02c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:37.067422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:37.071800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be1bf2-306d-4b93-a25f-5b65a13ec02c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:37.109033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:37.109867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.110157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.110462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.122251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:37.133673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:37.134795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:07:37.135785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 585/1195] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:37.141404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:37.198523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:37.251217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253312-918a-48be-89a1-09f6bd6ee196 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:37.300655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:37.301446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.301734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.302014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.302769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:37.303075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:37.304462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:37.317513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 611/1196] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:37.323553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:37.444127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a62591-8fa8-47cc-b6f9-450a88096fad None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:37.480757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:37.481678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.481969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.482244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] PATH_INFO: `/v3/users/8cb6dba624554d30afc164f65d6c2d25` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.483503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] RBAC: Authorizing `identity:get_user(user_id=8cb6dba624554d30afc164f65d6c2d25)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:37.484964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:37.486681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 586/1197] 10.222.0.113 () {56 vars in 1182 bytes} [Mon Jul 25 19:07:37 2022] GET /identity/v3/users/8cb6dba624554d30afc164f65d6c2d25 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:37.493083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:37.605646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ef7c3-4288-4a8b-ad4f-e15d71656591 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:37.619826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:37.641783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:37.642558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.642846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.643123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.715456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:37.716962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:37.822571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 612/1198] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:37 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:37.829075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:37.860528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:37.943937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99260f9-2793-41a7-8cb5-46133032bcb7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:37.982840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48c91-994f-4663-95a6-30ac71e6706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:37.983718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48c91-994f-4663-95a6-30ac71e6706a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.983996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48c91-994f-4663-95a6-30ac71e6706a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.984267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48c91-994f-4663-95a6-30ac71e6706a None admin] PATH_INFO: `/v3/projects/6fa329a69b57419592188293a97debe6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.985542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da48c91-994f-4663-95a6-30ac71e6706a None admin] RBAC: Authorizing `identity:get_project(project_id=6fa329a69b57419592188293a97debe6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:37.987001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da48c91-994f-4663-95a6-30ac71e6706a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:37.989073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 587/1199] 10.222.0.113 () {56 vars in 1191 bytes} [Mon Jul 25 19:07:37 2022] GET /identity/v3/projects/6fa329a69b57419592188293a97debe6 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:37.995503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:38.011671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:38.130292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72b86-5cbb-430e-9cf2-9c6de495b251 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:38.169697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:38.170426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:38.170921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:38.171197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:38.172436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=6fa329a69b57419592188293a97debe6, user.id=8cb6dba624554d30afc164f65d6c2d25) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:38.172744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:38.174239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ad7b7-0ebe-45af-8075-c3b80969d960 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:38.181190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 613/1200] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:37 2022] GET /identity/v3/role_assignments?user.id=8cb6dba624554d30afc164f65d6c2d25&scope.project.id=6fa329a69b57419592188293a97debe6&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:47.978742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=52 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:48.178064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=62 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:35.397894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc715e12-82d2-497a-93ab-4ee9cb2c8ca5 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:35.398508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc715e12-82d2-497a-93ab-4ee9cb2c8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:35.398508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc715e12-82d2-497a-93ab-4ee9cb2c8ca5 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:35.399827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 588/1201] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:08:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:35.406317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c552-22de-410c-9212-2df33334c768 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:35.407179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c552-22de-410c-9212-2df33334c768 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:35.407179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c552-22de-410c-9212-2df33334c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:35.434590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6195c552-22de-410c-9212-2df33334c768 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:35.436466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6195c552-22de-410c-9212-2df33334c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:35.544065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 614/1202] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:35.577247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc715e12-82d2-497a-93ab-4ee9cb2c8ca5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:35.722293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc715e12-82d2-497a-93ab-4ee9cb2c8ca5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:35.768516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:35.769462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:35.769791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:35.770075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:35.785467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:35.787279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:35.812712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:35.814206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:35.818584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:35.818584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:35.818584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:35.818584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:35.818584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 589/1203] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:35.820845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195c552-22de-410c-9212-2df33334c768 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:35.980767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195c552-22de-410c-9212-2df33334c768 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.026176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:36.037446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.042441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.042441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.042441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.042441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:36.042441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.042441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c09af-3b80-4276-abee-90a403d239b6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.060250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 615/1204] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:36.066923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:36.145949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:36.212309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcff2e-41b2-419f-832d-2d401636e31e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:36.270285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a93ce-c303-4a66-9815-173d5675dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:36.270933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a93ce-c303-4a66-9815-173d5675dd3d None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:36.271284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a93ce-c303-4a66-9815-173d5675dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:36.271626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a93ce-c303-4a66-9815-173d5675dd3d None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:36.272448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a93ce-c303-4a66-9815-173d5675dd3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:36.274082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a93ce-c303-4a66-9815-173d5675dd3d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:36.300341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 590/1205] 10.222.0.113 () {60 vars in 1137 bytes} [Mon Jul 25 19:08:36 2022] POST /identity/v3/users => generated 252 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:08:38.625821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfabae-2239-4ec7-8226-e01c8db15bcb None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:38.626552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfabae-2239-4ec7-8226-e01c8db15bcb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:38.626552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfabae-2239-4ec7-8226-e01c8db15bcb None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:38.628830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 616/1206] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:08:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:38.634504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:38.635064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:38.635064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:38.655013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:38.656236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:38.754467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 591/1207] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:38.788673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfabae-2239-4ec7-8226-e01c8db15bcb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:38.928753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfabae-2239-4ec7-8226-e01c8db15bcb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:38.975952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:38.977294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:38.977765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:38.978154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:38.992552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:39.000388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:39.001640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:39.002843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 617/1208] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:39.008270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:39.073464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:39.165195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f10730-93ea-4e09-a3b8-063f388e89aa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:39.210572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:39.211228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:39.211543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:39.211830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:39.212640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:39.212994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:39.214471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:39.230249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 592/1209] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:08:39 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:39.231648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:39.305031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:39.387342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef846-7b9f-4faf-8067-52ba0cee3227 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:39.438207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:39.439854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:39.440220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:39.440435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:39.457478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:39.459002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:39.480695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:39.481750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:39.482662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:39.482662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:39.482662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:39.482662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:39.482662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 618/1210] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:39.488668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:39.613666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:39.617225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cde8d-13ac-44bb-8b25-083f63add8d2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:39.666975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:39.666975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:39.666975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:39.666975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:39.667852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:39.667924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:39.669683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:39.685304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 593/1211] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:39.691956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:39.817075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099c2b-605d-4f18-a430-f0a4b406f42d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:39.819340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:39.865871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:39.866956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:39.867246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:39.867514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:39.877076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:39.878903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:39.895969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:39.897045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:39.898370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 619/1212] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:39.903347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:40.021852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ad042-72fa-48d0-87be-a6b870a9eb95 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:40.067372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:40.068206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:40.068495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:40.068810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:40.069950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:40.070301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:40.072034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:40.103405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 594/1213] 10.222.0.113 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:40.105424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:40.257870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6997-c900-4ca0-b66b-c227d980c4d0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:40.299158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:40.300323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:40.300647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:40.300929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:40.338550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:40.403434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:40.406266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:40.549034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 620/1214] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:08:40 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:08:40.555210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:40.581299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:40.688874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775b2d3-5552-4d7a-a834-4e88491d7c29 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:40.734182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:40.735137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:40.735465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:40.735880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:40.749404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:40.751126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:40.771853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:40.773107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:40.774501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:40.774501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:40.774501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:40.774501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:40.774501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 595/1215] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:08:40.779031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:40.851433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:40.899426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fa0d2-fece-493e-89f6-4f3153e2f59f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:40.944897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:40.945574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:40.945956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:40.946473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:40.947364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:40.947730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:40.949479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:40.971173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 621/1216] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:40.972898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:41.060232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:41.100690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef589a1-f083-45b3-b4e7-7f36c6190fc5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:41.144287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:41.145525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:41.146046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:41.146623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:41.155977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:41.159022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:08:41.175034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:41.176353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:41.177513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:41.178492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 596/1217] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:41.184190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:41.305954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484bea-ec78-49cf-a79b-c06720ce567b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:41.339736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:41.358409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:41.359259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:41.359550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:41.359912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:41.360886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:41.361235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:41.362720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf176f3-25d7-4383-8258-baa2a16b48da None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:41.378470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 622/1218] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:41.385315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:41.531445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a063bc0-5b87-482b-9d0c-749d635e8930 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:41.576248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:41.584269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:41.585477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:41.585889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:41.586277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:41.587360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=24596930fed646f6ba8ea30e43dbbcfd) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:41.587903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:41.589746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd968d5-0f69-494a-b1bd-31da3dcd475a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:41.604519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 597/1219] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:08:41 2022] GET /identity/v3/role_assignments?user.id=24596930fed646f6ba8ea30e43dbbcfd&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:08:43.798154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486078-22f0-4397-bb28-692e71b2a36b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.798803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486078-22f0-4397-bb28-692e71b2a36b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.798939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486078-22f0-4397-bb28-692e71b2a36b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.800366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 623/1220] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:08:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:43.806496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:43.807104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:43.807299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:43.826946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:43.828169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:43.912227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 598/1221] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:43 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:43.934767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c486078-22f0-4397-bb28-692e71b2a36b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.055187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c486078-22f0-4397-bb28-692e71b2a36b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.102234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.103286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.103698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.104097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.117547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:44.125368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:44.126624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:44.132682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 624/1222] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:44.134025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.250128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fcd6-0de2-4af4-bd2d-b36927a36c47 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.291387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:44.303101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.303779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.304059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.304327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.305075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:44.305461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.306795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.316193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 599/1223] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:08:44.323337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.382277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:44.449745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f773b-4f3d-4d59-b532-a214acb6f9e4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.487880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.488898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.489317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.489715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.502483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.503988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:44.522519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:44.523760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:44.524928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:44.524928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:44.524928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:44.524928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:44.530193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 625/1224] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:44.530359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.659769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdfa9a-381d-4d93-8562-1893cdf28347 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.699801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.700480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.700766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.701047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.701819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:44.702132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.703521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.718468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 600/1225] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:44.724595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.838960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:44.847627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1a41-59e7-4fef-b118-2eec699e2f5a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:44.887902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:44.888695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:44.888979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:44.889309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:44.898669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:44.900151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:44.916063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:44.917392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:44.918565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 626/1226] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:08:44.924170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:44.984825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:45.047041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527be16-4ba4-427a-972f-c534fff74601 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:45.094008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:45.094962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:45.095252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:45.095598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:45.096448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:45.096757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:45.098246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:45.119034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 601/1227] 10.222.0.113 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:45.124725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:45.258216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3afb1-6ebc-46df-b912-5b73f889859f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:45.298661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:45.300421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:45.300950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:45.301447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:45.316547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:45.318105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:45.340729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:45.341807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:45.342703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:45.342703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:45.342703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:45.342703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:45.342703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 627/1228] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:45.350401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:45.491919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c723de-b0d3-4801-a4cc-aefea3d76dc1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:45.495325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:45.532987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:45.533713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:45.534001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:45.534283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:45.535054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:45.535534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:45.537085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:45.551756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 602/1229] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:45.558594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:45.569320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:45.692816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4b39a-3523-4079-b6d3-dbfbe5ffb38f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:45.750634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:45.751512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:45.754465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:45.754465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:45.759701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:45.761189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:08:45.778385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:45.779808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:45.780945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 628/1230] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:45.786585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:45.905867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483862-cc80-4657-bd47-44386c77f61c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:45.954293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:45.955396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:45.955900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:45.956426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:45.957952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:45.958513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:45.961101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d3416-1e7d-43a3-80a4-4533dc70e126 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:45.978286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 603/1231] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:45.985158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:46.065276 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:46.112827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f0f09-5e5c-4ac2-b1f8-88c3642f7c53 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:46.154141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf82bb-d4a5-4ab3-9638-3d6bb307d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:46.155435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf82bb-d4a5-4ab3-9638-3d6bb307d0e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:46.155720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf82bb-d4a5-4ab3-9638-3d6bb307d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:46.155996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf82bb-d4a5-4ab3-9638-3d6bb307d0e9 None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/24596930fed646f6ba8ea30e43dbbcfd/roles/2f30d2893bd04b0cbe1b22f48ce139e8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:46.177177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf82bb-d4a5-4ab3-9638-3d6bb307d0e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=24596930fed646f6ba8ea30e43dbbcfd, role_id=2f30d2893bd04b0cbe1b22f48ce139e8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:46.179037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf82bb-d4a5-4ab3-9638-3d6bb307d0e9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:46.193557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 629/1232] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:08:45 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/24596930fed646f6ba8ea30e43dbbcfd/roles/2f30d2893bd04b0cbe1b22f48ce139e8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:08:48.276945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc15b1b-e8b1-4d51-af87-aafb386569f5 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:48.277521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc15b1b-e8b1-4d51-af87-aafb386569f5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:48.277521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc15b1b-e8b1-4d51-af87-aafb386569f5 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:48.278954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 604/1233] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:08:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:48.284739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:48.285383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:48.285383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:48.308449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:48.309835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:48.402634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 630/1234] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:48 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:48.427061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc15b1b-e8b1-4d51-af87-aafb386569f5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:48.457540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:48.547841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc15b1b-e8b1-4d51-af87-aafb386569f5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:48.590408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:48.591225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:48.591508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:48.591779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:48.604001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:48.612071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:48.613334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:48.614210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 605/1235] 10.222.0.113 () {56 vars in 1107 bytes} [Mon Jul 25 19:08:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:48.620466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:48.681580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:48.743718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8108bf-db63-4bd3-b6d2-c583ee4ad150 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:48.793400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:48.794526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:48.794944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:48.795727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:48.796543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:48.796892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:48.799073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:48.808498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 631/1236] 10.222.0.113 () {56 vars in 1108 bytes} [Mon Jul 25 19:08:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:48.814770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:48.921816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:48.947153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d705-5442-412f-b9fc-0cac3dd98ab0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:48.985422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:48.986564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:48.986856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:48.987268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:48.999233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:49.000815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:49.020183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:49.021309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:49.022234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:49.022234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:49.022234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:49.022234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:49.022234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 606/1237] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:49.027379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:49.149258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50078c90-c5f0-4e97-8481-3aaf878eeae4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:49.159371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:49.193038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:49.193687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:49.194376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:49.194376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:49.194983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:49.195234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:49.196903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:49.219434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 632/1238] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:49.220801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:49.348442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499fe5e-6675-48ef-94de-e65f6cd5ff35 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:49.412748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:49.414088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:49.414705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:49.415170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:49.419898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:49.426560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:49.428042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:49.445138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:49.446666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:49.447950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 607/1239] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:49.453850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:49.571725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80795d-d0ff-4f15-bb43-01e64f349556 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:49.615510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:49.616193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:49.616477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:49.616753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:49.617634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:49.617944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:49.619485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:49.639319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 633/1240] 10.222.0.113 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:49.646360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:49.768303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8cc28-1d2b-43ab-b276-d4b10e2eadb2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:49.803407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:49.804078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:49.804338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:49.804617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:49.875932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:49.883654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:49.885108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:49.995934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 608/1241] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:08:49 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:08:50.002499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.034126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.121417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ce00d-c2ed-48fc-927f-06973ee4fa18 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.162794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.163747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.164209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.164610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.177931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.179673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:50.200432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:50.201588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:50.202589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:50.202589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:50.202589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:50.202589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:50.202589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 634/1242] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:50.207737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.322867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.335094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210a71-2404-4b8e-957c-2ee7227645e0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.378672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.378672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.379623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.379623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.380136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:50.380510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.382145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.396421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 609/1243] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:50.402341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.498281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.524168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f794c-d4ee-416a-a674-086f37863b45 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.563615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.564523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.564803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.565075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.572720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.574459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:08:50.589652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:50.590720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:50.591652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 635/1244] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:50.597254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.721556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbec2e-141a-449b-986a-d6729e65735a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.759319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.759989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.760267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.760541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.762884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:50.762884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.763133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696989-148b-4fd7-bb82-ac88c29d100a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.778044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 610/1245] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:50.786070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.913672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b1114-6bd3-4571-b8b0-25b96fae35e3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.958402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.959270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.959712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.960077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.961061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] RBAC: Adding query filter params (role.id=2f30d2893bd04b0cbe1b22f48ce139e8, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=24596930fed646f6ba8ea30e43dbbcfd) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:50.961554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.963503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51fab8-1587-4379-8a6e-7cc9ebb36dbd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.970681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 636/1246] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/role_assignments?user.id=24596930fed646f6ba8ea30e43dbbcfd&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=2f30d2893bd04b0cbe1b22f48ce139e8 => generated 610 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:53.205533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581144c4-4cf9-48c8-8898-2283e58817cd None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.206279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581144c4-4cf9-48c8-8898-2283e58817cd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.206279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581144c4-4cf9-48c8-8898-2283e58817cd None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.207715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 611/1247] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:08:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:53.213739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.214242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.214415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.221626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:53.236948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:53.238282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:53.315771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 637/1248] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:53.344979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581144c4-4cf9-48c8-8898-2283e58817cd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:53.372145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:53.487076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581144c4-4cf9-48c8-8898-2283e58817cd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:53.528876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:53.529733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.529996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.530288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.544967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:53.552869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:53.554096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:53.555089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 612/1249] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:08:53.560818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:53.676902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57a37-9999-41b7-b716-f77c56efea2c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:53.708128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:53.714311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:53.715114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.715423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.715730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.716497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:53.716866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:53.718471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:53.729032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 638/1250] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:53.734773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:53.825223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:53.849941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262178e-55d7-4c32-bbed-05d8f0e6b145 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:53.896386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:53.897472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.897803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.898131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.912527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:53.914152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:53.933012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:53.934074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:53.935340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:53.935340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:53.935340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:53.935340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:53.939495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 613/1251] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:53.940726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.070781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042efbd1-0570-4901-8ec2-c0cf80205020 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.114671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.115297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.115585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.115867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.116586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:54.116897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.118344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.133534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 639/1252] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:54.139736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.252024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6329-1fc0-43b7-b20c-85775f51bfba None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.283498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:54.292823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.293712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.293989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.294310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.302661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.304394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:54.320714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:54.321759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:54.322717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 614/1253] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:08:54.328534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.407784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:54.464936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f039a-0d81-4cd0-b1a4-1adc240f643f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.511450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.512160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.512442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.512710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.513595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:54.513902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.515363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.535721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 640/1254] 10.222.0.113 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:54.541681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.652916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f255c3-1632-4797-b2a4-66074edab1a2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.697552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.698256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.698544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.698822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.770968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:54.793443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.794972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.923350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 615/1255] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:08:54.929497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.044629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c73e19-a1e2-47ac-914d-e30de67ba5c9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.061527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.093613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.094803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.095270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.095554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.113060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.114593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:55.140386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:55.147097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:55.148301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:55.148301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:55.148301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:55.148301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:55.148301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 641/1256] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:55.148660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.250342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.263384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29efaa-a66c-4438-bac0-adc993b21160 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.302316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.302985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.303249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.303528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.304294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:55.304565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.305982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.318845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 616/1257] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:55.326477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.438212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab955-ac45-4d70-b906-8191dde93318 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.480528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.481379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.481666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.481935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.490246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.491763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:08:55.506620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:55.507847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:08:55.508934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 642/1258] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:55.514177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.637007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09912c41-68f3-478b-9332-f90bc3becc22 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.681296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.682071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.682442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.682777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.683643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:55.684039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.686248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea6f4a-1214-4078-acaf-966e00057e94 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.704894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 617/1259] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:55.712669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.745477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.839463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe37232-95a6-4968-9e7e-b7ae96fd9834 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.877373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.878157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.878509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.878852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.879811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=24596930fed646f6ba8ea30e43dbbcfd) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:55.880126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.881680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95291ce-784c-43cc-bf94-9315f1f7d77e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.887851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 643/1260] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/role_assignments?user.id=24596930fed646f6ba8ea30e43dbbcfd&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:57.966226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9085f83-6755-42f6-b4c8-7911227b967c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:57.966787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9085f83-6755-42f6-b4c8-7911227b967c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:57.966787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9085f83-6755-42f6-b4c8-7911227b967c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:57.968152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 618/1261] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:08:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:57.975574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:57.976429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:57.976429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:57.996656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:57.997900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:58.072160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 644/1262] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:57 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:58.105377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9085f83-6755-42f6-b4c8-7911227b967c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.122402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:58.235167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9085f83-6755-42f6-b4c8-7911227b967c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.272681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.273510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.273788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.274060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.285891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:58.293619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:58.294855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:58.296195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 619/1263] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:58.303266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.325099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:58.436627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53defc-3cff-4a0e-a018-c590deb42c45 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.477072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.477783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.478071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.478348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.479105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:58.479413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:58.480818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:58.493686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 645/1264] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:58.499676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.578007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:58.618409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2ec59-f730-4a50-93cf-8236fec4f471 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.654187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.654990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.655266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.655533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.666957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:58.668440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:58.685839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:58.686928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:58.687918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:58.687918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:58.687918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:58.687918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:58.687918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 620/1265] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:58.693800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.792238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:58.814087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd75b8-083d-47a2-9ba9-f0ca14c3729d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.849853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.850517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.850795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.851369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.852092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:58.852390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:58.853796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:58.868787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 646/1266] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:58.876059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.990920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53b44c-adf9-4193-bd1f-b65380817bb7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.012604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.029397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.030213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.030506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.030807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.039318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.040791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:59.056116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:59.057289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:59.058435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 621/1267] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:59.064214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.183781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700e5ff-89ea-40da-a70d-c01424f6a3cb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.224133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.224821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.225106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.225503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.227163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:59.227577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.229684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.239742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.249786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 647/1268] 10.222.0.113 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:59.255826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.373743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9f66-3fa8-4ebf-8065-00914ce40ba5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.411399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.412214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.412495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.412769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.425017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.426532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:59.445003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:59.446132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:59.447485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:59.447485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:59.447485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:59.447485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:59.447485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 622/1269] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:59.452284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.569825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112d2ff-7312-405f-9ef7-a3e217da431a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.606994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.607675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.607957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.608235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.608958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:59.609297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.610755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.622948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 648/1270] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:59.629283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.666919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.741650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dcf94-b34d-4b78-a80d-55d2863a0314 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.783221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.784025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.784310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.784584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.791953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.793461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:08:59.808113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:59.809390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:08:59.810659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 623/1271] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:59.817719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.888560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.940508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794fd3-346c-4986-9de7-0c7bd1fd4f49 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.978957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.979637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.979923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.980201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.981029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:59.981379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.982847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773422fc-0611-4a8b-b2b6-030d35b43f53 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.996213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 649/1272] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:00.003479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:00.113441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:00.125530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6c138-fd2c-4733-99fc-dcd282840d91 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:00.172798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d223ea-d8fc-41a3-8f68-3b84f3de375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:00.173765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d223ea-d8fc-41a3-8f68-3b84f3de375b None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.174043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d223ea-d8fc-41a3-8f68-3b84f3de375b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.174314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d223ea-d8fc-41a3-8f68-3b84f3de375b None admin] PATH_INFO: `/v3/projects/0e64fcc04df04f97955525386c90a40e/users/24596930fed646f6ba8ea30e43dbbcfd/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.176422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d223ea-d8fc-41a3-8f68-3b84f3de375b None admin] RBAC: Authorizing `identity:create_grant(project_id=0e64fcc04df04f97955525386c90a40e, user_id=24596930fed646f6ba8ea30e43dbbcfd, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:00.178006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d223ea-d8fc-41a3-8f68-3b84f3de375b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:00.195830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 624/1273] 10.222.0.113 () {58 vars in 1444 bytes} [Mon Jul 25 19:09:00 2022] PUT /identity/v3/projects/0e64fcc04df04f97955525386c90a40e/users/24596930fed646f6ba8ea30e43dbbcfd/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:09:02.193226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d8849-0847-46b7-94a8-278978252ee4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.193819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d8849-0847-46b7-94a8-278978252ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.193819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d8849-0847-46b7-94a8-278978252ee4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.195162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 650/1274] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:09:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:02.200768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.201292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.201381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.224257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:02.225520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:02.303954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 625/1275] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:02 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:02.327801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d8849-0847-46b7-94a8-278978252ee4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:02.443878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d8849-0847-46b7-94a8-278978252ee4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:02.465040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:02.489248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:02.490066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.490346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.490617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.502607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:09:02.510201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:02.511293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:02.512358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 651/1276] 10.222.0.113 () {56 vars in 1101 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:02.518934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:02.612401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:02.632733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7133944-4dc5-4480-aad3-1c2aa0c0928d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:02.668402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:02.669075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.669389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.669668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.670423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:02.670735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:02.672343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:02.681646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 626/1277] 10.222.0.113 () {56 vars in 1104 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:02.687721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:02.808158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a12a-ffcf-49b8-96dc-3a974646b836 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:02.844057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:02.845002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.845307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.845583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.858372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:02.860001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:02.878008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:02.879101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:02.880036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:02.880036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:02.880036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:02.880036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:02.880036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 652/1278] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:02.885353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.002541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade84f-5fb1-49ea-a5e7-9e2dda67a37d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.038416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.039085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.039370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.039644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.040372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:03.040681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.042091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.054777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 627/1279] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:03.060852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.109151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.213440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11e91c-dd09-400e-87af-e9c6dfc0a3bc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.250147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.250975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.251248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.251513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.260119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.261612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:09:03.276773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:03.278001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:03.279175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 653/1280] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:03.284570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.288666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.401725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dfa1c-eace-407f-bf09-a40d2660dcd2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.441778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.442465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.442756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.443027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.443875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:03.444180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.445770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.464686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 628/1281] 10.222.0.113 () {56 vars in 1148 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:03.470997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.577144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.588292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf12b4e-f78d-4b79-bd51-2a17c5b22336 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.633663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.634168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.634445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.634716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.708933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.710417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.806426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.818608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 654/1282] 10.222.0.113 () {58 vars in 1287 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:09:03.824690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.893989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.935578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3859b-d026-419c-be87-e046cbeadb5a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.971082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.971881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.972160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.972432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.983865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.985652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:04.004493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:04.005682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:04.006795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:04.006795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:04.006795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:04.006795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:09:04.006795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 629/1283] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:04.013308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.127918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af22793-c5aa-4c02-8931-9c4fcd082b8c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.165609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.166172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.166458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.166733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.167450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:04.167751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.169174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.181958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 655/1284] 10.222.0.113 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:04.188588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.306801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a3e85-350c-443d-ae50-a9b6179fc734 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.323066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:04.345035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.345880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.346165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.346444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.353753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.355209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:09:04.370190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:04.372141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 25 19:09:04.374063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 630/1285] 10.222.0.113 () {56 vars in 1116 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:04.378122 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.447736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:04.507476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4955-d9ff-44ee-9fcc-32ecf395219c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.544291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.544932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.545236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.545508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.546296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:04.546610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.548311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39ae17-79c0-4589-86e6-67f8762ad2b0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.565669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 656/1286] 10.222.0.113 () {56 vars in 1153 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:04.570233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.688658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ac93d-486e-4a14-a2dc-eee9f67fbb8a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.727949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.728516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.728798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.729076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.729936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] RBAC: Adding query filter params (role.id=6a0cf49bc31549b3b4c741ce358913de, scope.project.id=0e64fcc04df04f97955525386c90a40e, user.id=24596930fed646f6ba8ea30e43dbbcfd) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:04.730249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.731727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963682ef-d388-4e5c-b1e2-f6c08ea968c1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.738747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 631/1287] 10.222.0.113 () {56 vars in 1379 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/role_assignments?user.id=24596930fed646f6ba8ea30e43dbbcfd&scope.project.id=0e64fcc04df04f97955525386c90a40e&role.id=6a0cf49bc31549b3b4c741ce358913de => generated 610 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:06.779740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebfa64-4874-483d-899b-545e0ab7f3f6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:06.780286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebfa64-4874-483d-899b-545e0ab7f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:06.780286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebfa64-4874-483d-899b-545e0ab7f3f6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:06.781774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 657/1288] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:09:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:06.787703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:06.788196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:06.788312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:06.808759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:06.810341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:06.846164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:06.887209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 632/1289] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:06.910031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebfa64-4874-483d-899b-545e0ab7f3f6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:07.030727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebfa64-4874-483d-899b-545e0ab7f3f6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:07.046708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:07.076314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:07.077164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:07.077455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:07.077732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:07.078720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:07.080438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:07.095353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:07.096658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:07.098270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 658/1290] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:09:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:07.104949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:07.229903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eba2a6-bca9-477e-a5c9-cb9c51561d15 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:07.269755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:07.270518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:07.270824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:07.271073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:07.271835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:07.272138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:07.273550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13df50-b768-41f1-8ee0-07f007d1cc35 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:07.278977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 633/1291] 10.222.0.113 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:07 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:07.285558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:07.420963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5cbe-c53c-4a80-9427-bd4c7014621f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:07.459991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:07.460675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:07.460955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:07.461270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:07.461987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:07.462297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:07.463699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa555a05-49b8-4e7e-99ea-3088b30bd0bd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:07.468447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 659/1292] 10.222.0.113 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:07 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:09.457786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2138e-4b5f-4fc0-bb7e-f678e015c4ad None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.458327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2138e-4b5f-4fc0-bb7e-f678e015c4ad None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.458327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2138e-4b5f-4fc0-bb7e-f678e015c4ad None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.459737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 634/1293] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:09:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:09.466204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c899c9-3ce5-4b3e-af89-a5eba2cd9ec5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.466926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c899c9-3ce5-4b3e-af89-a5eba2cd9ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.467057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c899c9-3ce5-4b3e-af89-a5eba2cd9ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.487733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-77c899c9-3ce5-4b3e-af89-a5eba2cd9ec5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:09.488960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-77c899c9-3ce5-4b3e-af89-a5eba2cd9ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:09.526242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:09.574952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 660/1294] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:09 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:09.598230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2138e-4b5f-4fc0-bb7e-f678e015c4ad None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:09.633170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:09.709761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2138e-4b5f-4fc0-bb7e-f678e015c4ad None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:09.748893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e65c7-284a-4e7a-aaeb-e4dc20c8ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:09.749595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e65c7-284a-4e7a-aaeb-e4dc20c8ace2 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.750156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e65c7-284a-4e7a-aaeb-e4dc20c8ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.750394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e65c7-284a-4e7a-aaeb-e4dc20c8ace2 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.751112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e65c7-284a-4e7a-aaeb-e4dc20c8ace2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:09.752527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e65c7-284a-4e7a-aaeb-e4dc20c8ace2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:09.769109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 635/1295] 10.222.0.113 () {60 vars in 1146 bytes} [Mon Jul 25 19:09:09 2022] POST /identity/v3/services => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:09:11.814942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52aff6-081b-4db2-84ec-23d7e0910399 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:11.815469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52aff6-081b-4db2-84ec-23d7e0910399 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:11.815469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52aff6-081b-4db2-84ec-23d7e0910399 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:11.816771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 661/1296] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:09:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:11.822210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:11.822670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:11.822761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:11.842051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:11.843249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:11.921025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 636/1297] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:11 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:11.943747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52aff6-081b-4db2-84ec-23d7e0910399 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:12.060024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52aff6-081b-4db2-84ec-23d7e0910399 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:12.099340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:12.100311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.100619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.101272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.101963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:12.103856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:12.117546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:12.118570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:12.119442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 662/1298] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:09:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:12.126364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:12.153016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:12.243155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82342366-6677-4aaf-a14e-e59d876156cb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:12.278973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:12.279690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.279971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.280242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.281089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:12.281423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:12.282858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:12.288795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 637/1299] 10.222.0.113 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:12 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:12.294977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:12.327415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:12.406686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a0af-f259-473d-9537-a0062d5298ae None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:12.448008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:12.448688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.448971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.449285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.450085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] RBAC: Adding query filter params (interface=public, service_id=cfde265460c742e8a19bdb274b85acee, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:12.450398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:12.451784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697212-1138-489d-8942-2e5bfd719ca5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:12.458067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 663/1300] 10.222.0.113 () {56 vars in 1256 bytes} [Mon Jul 25 19:09:12 2022] GET /identity/v3/endpoints?service_id=cfde265460c742e8a19bdb274b85acee&interface=public®ion_id=RegionOne => generated 195 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:12.464885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:12.579295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:12.597903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed750b-0765-43ac-a032-9804f487e70e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:12.634585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3c40-fd1a-4be8-98f3-28c02f2351cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:12.635165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3c40-fd1a-4be8-98f3-28c02f2351cb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.635448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3c40-fd1a-4be8-98f3-28c02f2351cb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.635721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3c40-fd1a-4be8-98f3-28c02f2351cb None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.636412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc3c40-fd1a-4be8-98f3-28c02f2351cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:12.637823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc3c40-fd1a-4be8-98f3-28c02f2351cb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:12.644785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 638/1301] 10.222.0.113 () {56 vars in 1092 bytes} [Mon Jul 25 19:09:12 2022] GET /identity/v3/services => generated 2201 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:09:14.646063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf07a-0eba-4e74-90d4-cc5f410b00b5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.646625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf07a-0eba-4e74-90d4-cc5f410b00b5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.646625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf07a-0eba-4e74-90d4-cc5f410b00b5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.647919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 664/1302] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:09:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:14.653267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.653758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.653857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.672693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:14.673916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:14.761731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 639/1303] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:14 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:09:14.789324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf07a-0eba-4e74-90d4-cc5f410b00b5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:14.894380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:14.901850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf07a-0eba-4e74-90d4-cc5f410b00b5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.941192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.942050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.942328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.942609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.943280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:14.944672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:14.957763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:14.960158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 25 19:09:14.961747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 665/1304] 10.222.0.113 () {56 vars in 1122 bytes} [Mon Jul 25 19:09:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:14.966239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:15.054906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:15.081422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8b7de-75b7-4487-9ae2-aa681f91dfcc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:15.116330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:15.117029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:15.117342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:15.117617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:15.118330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:15.118630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:15.119999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444827-60f2-403c-8971-19c804b3c34e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:15.125855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 640/1305] 10.222.0.113 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:14 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:15.131934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:15.251453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b4195-d94f-447d-8d19-ca5c645683fd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:15.288569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d8a62-81e4-464b-bd93-1068bfc9be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:15.289270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d8a62-81e4-464b-bd93-1068bfc9be03 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:15.289552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d8a62-81e4-464b-bd93-1068bfc9be03 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:15.289829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d8a62-81e4-464b-bd93-1068bfc9be03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:15.290577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d8a62-81e4-464b-bd93-1068bfc9be03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:15.291963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d8a62-81e4-464b-bd93-1068bfc9be03 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:15.321969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 666/1306] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:09:15 2022] POST /identity/v3/endpoints => generated 333 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:09:25.122252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=30 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:25.313163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:19.575675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdff29-7e04-417e-bf62-4f1bf8c5f356 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:19.576741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdff29-7e04-417e-bf62-4f1bf8c5f356 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:19.577292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdff29-7e04-417e-bf62-4f1bf8c5f356 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:19.585030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 641/1307] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:19 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:19.587383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589816-9d6c-4275-9f78-ca0e8adffdd2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:19.587788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589816-9d6c-4275-9f78-ca0e8adffdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:19.588048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589816-9d6c-4275-9f78-ca0e8adffdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:19.720832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fa589816-9d6c-4275-9f78-ca0e8adffdd2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:19.722853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fa589816-9d6c-4275-9f78-ca0e8adffdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:19.885987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 667/1308] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:19.937336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8d8ba-9ce1-4116-90ae-81f99d72231f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:19.937624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8d8ba-9ce1-4116-90ae-81f99d72231f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:19.937905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8d8ba-9ce1-4116-90ae-81f99d72231f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:19.939464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 642/1309] 10.222.0.113 () {54 vars in 970 bytes} [Mon Jul 25 19:10:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:19.946195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc009b-9eb1-4db7-af1a-254810d2fdb7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:19.946482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc009b-9eb1-4db7-af1a-254810d2fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:19.946757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc009b-9eb1-4db7-af1a-254810d2fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:20.038501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-85fc009b-9eb1-4db7-af1a-254810d2fdb7 None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:20.040028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-85fc009b-9eb1-4db7-af1a-254810d2fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:20.070087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:20.138416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 668/1310] 10.222.0.113 () {58 vars in 1067 bytes} [Mon Jul 25 19:10:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:20.147470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8d8ba-9ce1-4116-90ae-81f99d72231f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:20.149551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2ea8d8ba-9ce1-4116-90ae-81f99d72231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:20.284232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8d8ba-9ce1-4116-90ae-81f99d72231f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:20.368941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:20.369542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:20.369821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:20.370312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:20.375584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:20.445535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:20.510552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:20.512149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afd18f-e099-4056-bc16-f378fb946376 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:20.535692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 643/1311] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:22.876974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767633-e3a3-424b-99a9-a61e4fe6edff None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:22.877565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767633-e3a3-424b-99a9-a61e4fe6edff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:22.877565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767633-e3a3-424b-99a9-a61e4fe6edff None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:22.878940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 669/1312] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:22.884303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00978-93f3-4065-b77f-7173fe6a4b0b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:22.884714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00978-93f3-4065-b77f-7173fe6a4b0b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:22.884994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00978-93f3-4065-b77f-7173fe6a4b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:22.973215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d4d00978-93f3-4065-b77f-7173fe6a4b0b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:22.974781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d4d00978-93f3-4065-b77f-7173fe6a4b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:23.077332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 644/1313] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:23.113401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767633-e3a3-424b-99a9-a61e4fe6edff None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:23.115030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bb767633-e3a3-424b-99a9-a61e4fe6edff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:23.229333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb767633-e3a3-424b-99a9-a61e4fe6edff None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:23.308895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:23.311654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:23.312360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:23.313071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:23.313407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:23.315730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:23.433308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:23.434837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a19f-780f-4c55-9864-6e33431b370f service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:23.455904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 670/1314] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:25.812878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a792b-1b7c-401a-885b-3b0354dddf23 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:25.813798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a792b-1b7c-401a-885b-3b0354dddf23 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:25.813798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a792b-1b7c-401a-885b-3b0354dddf23 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:25.815799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 645/1315] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:25.821453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d616e-d50a-4939-b03e-4b282851d641 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:25.821879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d616e-d50a-4939-b03e-4b282851d641 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:25.821991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d616e-d50a-4939-b03e-4b282851d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:25.896295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-470d616e-d50a-4939-b03e-4b282851d641 None None] MFA Rules not processed for user `2e90285b16a54207a853a3db25dd94f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:25.897460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-470d616e-d50a-4939-b03e-4b282851d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:25.955526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:26.004243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 671/1316] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:26.061000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e5675-24ad-44e0-8c80-8652750aa749 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:26.061327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e5675-24ad-44e0-8c80-8652750aa749 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:26.061604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e5675-24ad-44e0-8c80-8652750aa749 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:26.062965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 646/1317] 10.222.0.113 () {54 vars in 970 bytes} [Mon Jul 25 19:10:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:26.069368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac40383-be46-4afe-b2c3-8802a183964d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:26.069676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac40383-be46-4afe-b2c3-8802a183964d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:26.069950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac40383-be46-4afe-b2c3-8802a183964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:26.148018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bac40383-be46-4afe-b2c3-8802a183964d None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:26.149145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bac40383-be46-4afe-b2c3-8802a183964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:26.235652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 672/1318] 10.222.0.113 () {58 vars in 1067 bytes} [Mon Jul 25 19:10:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:26.249499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e5675-24ad-44e0-8c80-8652750aa749 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:26.251142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f2e5675-24ad-44e0-8c80-8652750aa749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:26.261433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:26.366532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e5675-24ad-44e0-8c80-8652750aa749 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:26.447854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:26.448406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:26.448683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:26.448957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:26.450711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:26.523597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:26.574967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:26.576488 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c49ea-ef19-472a-84ba-64479c742e30 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:26.596372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 647/1319] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:29.663779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc7b90-283d-45e1-9941-50afb7b0de7c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:29.664316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc7b90-283d-45e1-9941-50afb7b0de7c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:29.664316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc7b90-283d-45e1-9941-50afb7b0de7c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:29.665646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 673/1320] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:29.672334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb79840-039a-452c-83b9-e36f8ce577f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:29.673157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb79840-039a-452c-83b9-e36f8ce577f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:29.673313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb79840-039a-452c-83b9-e36f8ce577f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:29.769152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cdb79840-039a-452c-83b9-e36f8ce577f1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:29.770425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cdb79840-039a-452c-83b9-e36f8ce577f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:29.886143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 648/1321] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:29.926844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc7b90-283d-45e1-9941-50afb7b0de7c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:29.928396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b5fc7b90-283d-45e1-9941-50afb7b0de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:29.987488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:30.045890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc7b90-283d-45e1-9941-50afb7b0de7c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:30.123798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:30.124464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:30.124748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:30.125027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:30.126742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:30.238962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:30.253093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:30.254604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba0d4-66c5-402a-b58f-1bd527a2e3b5 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:30.272911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 674/1322] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:33.014033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d5044-2904-4d7c-9f1e-a6372572e40f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.014607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d5044-2904-4d7c-9f1e-a6372572e40f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.014607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d5044-2904-4d7c-9f1e-a6372572e40f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.015966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 649/1323] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:33.021477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811aa0e-eb84-41dc-b87f-33bb79bf0c95 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.021931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811aa0e-eb84-41dc-b87f-33bb79bf0c95 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.022054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811aa0e-eb84-41dc-b87f-33bb79bf0c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.111491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0811aa0e-eb84-41dc-b87f-33bb79bf0c95 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:33.113182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0811aa0e-eb84-41dc-b87f-33bb79bf0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:33.232354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 675/1324] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:33.269723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d5044-2904-4d7c-9f1e-a6372572e40f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:33.271411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-805d5044-2904-4d7c-9f1e-a6372572e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:33.293592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:33.407266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d5044-2904-4d7c-9f1e-a6372572e40f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:33.490265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:33.490926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.491207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.491477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.493164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:33.579159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:33.628682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:33.630150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dccdb-09c0-497a-86c1-032bf19612ef service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:33.650609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 650/1325] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:35.873881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b279-4e02-48f9-88cb-fcfbf817f122 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:35.874478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b279-4e02-48f9-88cb-fcfbf817f122 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:35.874478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b279-4e02-48f9-88cb-fcfbf817f122 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:35.876092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 676/1326] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:35.881238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382d97-6bbc-42f4-88e8-9dfc9c0378db None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:35.881703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382d97-6bbc-42f4-88e8-9dfc9c0378db None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:35.881932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382d97-6bbc-42f4-88e8-9dfc9c0378db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:35.958918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-86382d97-6bbc-42f4-88e8-9dfc9c0378db None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:35.960151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-86382d97-6bbc-42f4-88e8-9dfc9c0378db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:36.061770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 651/1327] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:36.099375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b279-4e02-48f9-88cb-fcfbf817f122 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:36.100957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b7e9b279-4e02-48f9-88cb-fcfbf817f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:36.164671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:36.213773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b279-4e02-48f9-88cb-fcfbf817f122 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:36.290492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:36.291145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:36.291427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:36.291701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:36.293455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:36.416116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:36.418327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:36.419899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e402c3-0ed5-41dc-837e-7fb05fc3d88d service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:36.440268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 677/1328] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:38.554085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6fb0e-03ca-4435-9b64-d9a44244cd1f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:38.554685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6fb0e-03ca-4435-9b64-d9a44244cd1f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:38.554685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6fb0e-03ca-4435-9b64-d9a44244cd1f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:38.556016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 652/1329] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:38.561910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba08de-e3c7-46aa-964c-1a84ec8c2bf3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:38.562400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba08de-e3c7-46aa-964c-1a84ec8c2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:38.562521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba08de-e3c7-46aa-964c-1a84ec8c2bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:38.640035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-82ba08de-e3c7-46aa-964c-1a84ec8c2bf3 None None] MFA Rules not processed for user `2e90285b16a54207a853a3db25dd94f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:38.641305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-82ba08de-e3c7-46aa-964c-1a84ec8c2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:38.752131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 678/1330] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:38.790620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6fb0e-03ca-4435-9b64-d9a44244cd1f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:38.792172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-71f6fb0e-03ca-4435-9b64-d9a44244cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:38.826604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:38.906080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6fb0e-03ca-4435-9b64-d9a44244cd1f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:39.001345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:39.003529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:39.003529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:39.003529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:39.004753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:39.098087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:39.130603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:39.132055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d41be-4534-4fde-a65d-d010d317a3e0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:39.150700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 653/1331] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:10:41.429766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceaee0-a07d-4ac8-94d7-d679fae545d3 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:41.430370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceaee0-a07d-4ac8-94d7-d679fae545d3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:41.430370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceaee0-a07d-4ac8-94d7-d679fae545d3 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:41.431689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 679/1332] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:41.437455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8166-be07-4db2-b503-dfa80129536b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:41.438018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8166-be07-4db2-b503-dfa80129536b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:41.438295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8166-be07-4db2-b503-dfa80129536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:41.514113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-694b8166-be07-4db2-b503-dfa80129536b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:41.516167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-694b8166-be07-4db2-b503-dfa80129536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:41.644996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 654/1333] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:41.682684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceaee0-a07d-4ac8-94d7-d679fae545d3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:41.684323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-abceaee0-a07d-4ac8-94d7-d679fae545d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:41.766042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:41.801986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceaee0-a07d-4ac8-94d7-d679fae545d3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:41.894133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:41.894701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:41.894976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:41.895245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:41.896906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:42.019220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:42.020928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f3f0b-5d98-4d83-abdb-db390d8680c6 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:42.031549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:42.040956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 680/1334] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:44.135630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63814334-cd20-409f-8b98-f1550dfc7637 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:44.136377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63814334-cd20-409f-8b98-f1550dfc7637 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:44.136377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63814334-cd20-409f-8b98-f1550dfc7637 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:44.137624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 655/1335] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:44.143208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02002e-ef4e-4df9-aca9-b20197f380ef None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:44.143653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02002e-ef4e-4df9-aca9-b20197f380ef None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:44.143765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02002e-ef4e-4df9-aca9-b20197f380ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:44.221364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cd02002e-ef4e-4df9-aca9-b20197f380ef None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:44.222583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd02002e-ef4e-4df9-aca9-b20197f380ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:44.327750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 681/1336] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:44.373071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63814334-cd20-409f-8b98-f1550dfc7637 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:44.375413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-63814334-cd20-409f-8b98-f1550dfc7637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:44.429201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:44.500666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63814334-cd20-409f-8b98-f1550dfc7637 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:44.576368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:44.577017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:44.577330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:44.577601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:44.579272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:44.667033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:44.695449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:44.696862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0a334-8700-40cf-9829-d2b312cbdbd8 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:44.718091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 656/1337] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:47.221986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ed77-ac6d-4445-af00-dc5b84900bb5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:47.222614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ed77-ac6d-4445-af00-dc5b84900bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:47.222614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ed77-ac6d-4445-af00-dc5b84900bb5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:47.224244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 682/1338] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:47.230177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c047-ee98-4517-bfb5-9905db8c8a18 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:47.230659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c047-ee98-4517-bfb5-9905db8c8a18 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:47.230761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c047-ee98-4517-bfb5-9905db8c8a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:47.297109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9827c047-ee98-4517-bfb5-9905db8c8a18 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:47.298350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9827c047-ee98-4517-bfb5-9905db8c8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:47.401061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 657/1339] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:10:47.438004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ed77-ac6d-4445-af00-dc5b84900bb5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:47.439567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ff82ed77-ac6d-4445-af00-dc5b84900bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:47.524088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:47.554910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ed77-ac6d-4445-af00-dc5b84900bb5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:47.631567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:47.632216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:47.632494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:47.632763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:47.634442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:47.753469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:47.754901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b0cbf-a91b-4ae5-970f-907a9baec7f8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:47.775283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 683/1340] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:52.013557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07e98-7cce-4170-8d0d-b3f7756f9741 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:52.014389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07e98-7cce-4170-8d0d-b3f7756f9741 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:52.014389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07e98-7cce-4170-8d0d-b3f7756f9741 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:52.017024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 658/1341] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:52 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:52.025497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247d603-6132-4087-84bf-d4c5b0b5d762 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:52.026163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247d603-6132-4087-84bf-d4c5b0b5d762 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:52.026163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247d603-6132-4087-84bf-d4c5b0b5d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:52.031910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:52.112794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4247d603-6132-4087-84bf-d4c5b0b5d762 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:52.114078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4247d603-6132-4087-84bf-d4c5b0b5d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:52.252291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 684/1342] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:52.283405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a07e98-7cce-4170-8d0d-b3f7756f9741 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:52.284962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-68a07e98-7cce-4170-8d0d-b3f7756f9741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:52.341422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:52.402398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a07e98-7cce-4170-8d0d-b3f7756f9741 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:52.480479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:52.481061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:52.481382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:52.481657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:52.484262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:52.585433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:52.603750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:52.605412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08164b-be1c-4ef2-a71f-473fa3072a10 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:52.625810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 659/1343] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:55.337678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ea4d5-ad4e-42a5-ae8b-b503790132fe None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:55.338282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ea4d5-ad4e-42a5-ae8b-b503790132fe None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:55.338282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ea4d5-ad4e-42a5-ae8b-b503790132fe None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:55.339679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 685/1344] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:10:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:55.345584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69daca-785c-4105-a83c-c8aae7aab1a6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:55.346075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69daca-785c-4105-a83c-c8aae7aab1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:55.346299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69daca-785c-4105-a83c-c8aae7aab1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:55.420154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0d69daca-785c-4105-a83c-c8aae7aab1a6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:55.421456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d69daca-785c-4105-a83c-c8aae7aab1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:55.527918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 660/1345] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:55.568735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ea4d5-ad4e-42a5-ae8b-b503790132fe None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:55.570348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ae8ea4d5-ad4e-42a5-ae8b-b503790132fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:55.677085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:55.695628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ea4d5-ad4e-42a5-ae8b-b503790132fe None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:55.773423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:55.774083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:55.774359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:55.774633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:55.776450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:55.891152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:55.892650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d885558-749d-40a6-b8a7-a0a4459d3f81 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:55.914683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 686/1346] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:00.297218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776772-0e6e-4834-9f8a-5b6bfc96d1cd None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:00.297760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776772-0e6e-4834-9f8a-5b6bfc96d1cd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:00.297760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776772-0e6e-4834-9f8a-5b6bfc96d1cd None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:00.299219 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 661/1347] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:00.305057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c39b5d-6748-4ada-8a66-6d9ee7fa3eba None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:00.305568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c39b5d-6748-4ada-8a66-6d9ee7fa3eba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:00.305765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c39b5d-6748-4ada-8a66-6d9ee7fa3eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:00.322634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:00.381471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b8c39b5d-6748-4ada-8a66-6d9ee7fa3eba None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:00.382704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b8c39b5d-6748-4ada-8a66-6d9ee7fa3eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:00.513785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 687/1348] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:00.552967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776772-0e6e-4834-9f8a-5b6bfc96d1cd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:00.554683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35776772-0e6e-4834-9f8a-5b6bfc96d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:00.620178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:00.670976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776772-0e6e-4834-9f8a-5b6bfc96d1cd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:00.749933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:00.750593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:00.750878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:00.751153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:00.752874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:00.873356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:00.877320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:00.879310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01df7b-3a93-4627-afeb-7b3868430b9e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:00.905707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 662/1349] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:05.907069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a140af-04c0-4b8a-b96e-2df039a2c3a7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:05.907821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a140af-04c0-4b8a-b96e-2df039a2c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:05.908244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a140af-04c0-4b8a-b96e-2df039a2c3a7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:05.910608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 688/1350] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:11:05 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:05.917409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f102-68a1-490c-b5f6-494f91327742 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:05.918025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f102-68a1-490c-b5f6-494f91327742 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:05.918025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f102-68a1-490c-b5f6-494f91327742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:06.045728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5b66f102-68a1-490c-b5f6-494f91327742 None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:06.046888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b66f102-68a1-490c-b5f6-494f91327742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:06.204326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 663/1351] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:11:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:10.431009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813fbe8-66dc-4afb-9836-51aca9dee6c0 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:10.431863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813fbe8-66dc-4afb-9836-51aca9dee6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:10.432559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813fbe8-66dc-4afb-9836-51aca9dee6c0 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:10.434753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 689/1352] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:11:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:10.439778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b1df9-1745-448e-9528-952e0b3a62f6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:10.440393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b1df9-1745-448e-9528-952e0b3a62f6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:10.440393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b1df9-1745-448e-9528-952e0b3a62f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:10.504187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:10.511752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=59 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:10.537001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-045b1df9-1745-448e-9528-952e0b3a62f6 None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:10.538293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-045b1df9-1745-448e-9528-952e0b3a62f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:10.661013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 664/1353] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:11:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:12.009606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07d161-2d4b-405f-b5e8-40846d1b37eb None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:12.010133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07d161-2d4b-405f-b5e8-40846d1b37eb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:12.010133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07d161-2d4b-405f-b5e8-40846d1b37eb None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:12.011846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 690/1354] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:11:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:12.016959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78f93-3bea-41fe-a0f2-30b0d80e665d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:12.017480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78f93-3bea-41fe-a0f2-30b0d80e665d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:12.017659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78f93-3bea-41fe-a0f2-30b0d80e665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:12.101737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c1c78f93-3bea-41fe-a0f2-30b0d80e665d None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:12.102936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c1c78f93-3bea-41fe-a0f2-30b0d80e665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:12.146878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:12.230677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 665/1355] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:11:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:15.772051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355a2e-189f-479c-91a4-7fcbcf28a31a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:15.772673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355a2e-189f-479c-91a4-7fcbcf28a31a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:15.772673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355a2e-189f-479c-91a4-7fcbcf28a31a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:15.778976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 691/1356] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:15 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:15.782231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c18b1-5aac-4b5c-bc2f-cb0d1e5b3148 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:15.782714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c18b1-5aac-4b5c-bc2f-cb0d1e5b3148 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:15.783662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c18b1-5aac-4b5c-bc2f-cb0d1e5b3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:15.915215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0f8c18b1-5aac-4b5c-bc2f-cb0d1e5b3148 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:15.917048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0f8c18b1-5aac-4b5c-bc2f-cb0d1e5b3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:16.088417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 666/1357] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:16.155473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dcfb3-66ab-4717-8a31-f799282e0c18 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:16.156385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dcfb3-66ab-4717-8a31-f799282e0c18 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:16.157912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dcfb3-66ab-4717-8a31-f799282e0c18 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:16.161966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 692/1358] 10.222.0.113 () {54 vars in 967 bytes} [Mon Jul 25 19:11:16 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:16.200412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c0be4-037a-4afe-baf4-71359077042b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:16.201247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c0be4-037a-4afe-baf4-71359077042b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:16.202069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c0be4-037a-4afe-baf4-71359077042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:16.228173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:16.305640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9f3c0be4-037a-4afe-baf4-71359077042b None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:16.307145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9f3c0be4-037a-4afe-baf4-71359077042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:16.444771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 667/1359] 10.222.0.113 () {58 vars in 1064 bytes} [Mon Jul 25 19:11:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:16.457981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dcfb3-66ab-4717-8a31-f799282e0c18 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:16.459633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-813dcfb3-66ab-4717-8a31-f799282e0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:16.633422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dcfb3-66ab-4717-8a31-f799282e0c18 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:16.738659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:16.785101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:16.785821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:16.786072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:16.786364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:16.788163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:16.895417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:16.897713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd9d0-7d1b-41de-8e49-256ed9faae1f service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:16.920677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 693/1360] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:19.193108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab83c4-ee2e-4f78-8c16-7ee332a8ed29 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:19.193835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab83c4-ee2e-4f78-8c16-7ee332a8ed29 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:19.194867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab83c4-ee2e-4f78-8c16-7ee332a8ed29 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:19.197489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 668/1361] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:19 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:19.203428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f6548-cba4-4427-944e-7e7755b1ef30 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:19.203993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f6548-cba4-4427-944e-7e7755b1ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:19.203993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f6548-cba4-4427-944e-7e7755b1ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:19.308772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-be6f6548-cba4-4427-944e-7e7755b1ef30 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:19.310482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-be6f6548-cba4-4427-944e-7e7755b1ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:19.361670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:19.449278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 694/1362] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:19.493934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab83c4-ee2e-4f78-8c16-7ee332a8ed29 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:19.493934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e9ab83c4-ee2e-4f78-8c16-7ee332a8ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:19.580674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:19.673339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab83c4-ee2e-4f78-8c16-7ee332a8ed29 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:19.800108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:19.800773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:19.801047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:19.801349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:19.803105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:19.830587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:19.908391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:19.910071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46f72-e753-4174-8271-2fe7e12f817d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:19.931098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 669/1363] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:22.334340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c146eb-a036-4020-ac94-fb1e76115b46 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:22.334910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c146eb-a036-4020-ac94-fb1e76115b46 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:22.334910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c146eb-a036-4020-ac94-fb1e76115b46 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:22.336284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 695/1364] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:22.342526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70204f-d193-4de6-86c8-55a9c7f52444 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:22.343258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70204f-d193-4de6-86c8-55a9c7f52444 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:22.343258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70204f-d193-4de6-86c8-55a9c7f52444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:22.436336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fb70204f-d193-4de6-86c8-55a9c7f52444 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:22.437618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb70204f-d193-4de6-86c8-55a9c7f52444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:22.550455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:22.561693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 670/1365] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:22.601764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97c72a-1ae7-4ec3-bed3-c8c6f8a811f9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:22.602033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97c72a-1ae7-4ec3-bed3-c8c6f8a811f9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:22.602574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97c72a-1ae7-4ec3-bed3-c8c6f8a811f9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:22.604579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 696/1366] 10.222.0.113 () {54 vars in 967 bytes} [Mon Jul 25 19:11:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:22.610282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb40a0-fd69-420c-bdeb-195ba65313d6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:22.610643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb40a0-fd69-420c-bdeb-195ba65313d6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:22.610966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb40a0-fd69-420c-bdeb-195ba65313d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:22.697551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-88fb40a0-fd69-420c-bdeb-195ba65313d6 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:22.698799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88fb40a0-fd69-420c-bdeb-195ba65313d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:22.831865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 671/1367] 10.222.0.113 () {58 vars in 1064 bytes} [Mon Jul 25 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:22.840067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97c72a-1ae7-4ec3-bed3-c8c6f8a811f9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:22.842305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ea97c72a-1ae7-4ec3-bed3-c8c6f8a811f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:23.092928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97c72a-1ae7-4ec3-bed3-c8c6f8a811f9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:23.121031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:23.256794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:23.257928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:23.258416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:23.258894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:23.262391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:23.385788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:23.387924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78b759-09d6-45f2-bb54-b664a108588f service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:23.421311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 697/1368] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:24.427507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a7b9-93fe-469f-b77a-ab9005757c40 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:24.428081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a7b9-93fe-469f-b77a-ab9005757c40 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:24.428081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a7b9-93fe-469f-b77a-ab9005757c40 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:24.429682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 672/1369] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:24.435476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc80c2-c363-4ad8-98a4-84dd85fd6ead None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:24.435951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc80c2-c363-4ad8-98a4-84dd85fd6ead None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:24.436226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc80c2-c363-4ad8-98a4-84dd85fd6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:24.471307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:24.512809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dccc80c2-c363-4ad8-98a4-84dd85fd6ead None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:24.514094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dccc80c2-c363-4ad8-98a4-84dd85fd6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:24.624240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 698/1370] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:24.927993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390380fc-c65d-4871-aeaa-3fcdff404c8a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:24.928266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390380fc-c65d-4871-aeaa-3fcdff404c8a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:24.928559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390380fc-c65d-4871-aeaa-3fcdff404c8a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:24.930181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 673/1371] 10.222.0.113 () {54 vars in 969 bytes} [Mon Jul 25 19:11:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:24.935188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7abef3-62e3-4f85-ad46-b20c080c47c7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:24.935479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7abef3-62e3-4f85-ad46-b20c080c47c7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:24.935748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7abef3-62e3-4f85-ad46-b20c080c47c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:25.036158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7a7abef3-62e3-4f85-ad46-b20c080c47c7 None None] MFA Rules not processed for user `59220145172c436b8995414a68d94bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:25.037401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a7abef3-62e3-4f85-ad46-b20c080c47c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:25.094825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:25.133079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 699/1372] 10.222.0.113 () {58 vars in 1066 bytes} [Mon Jul 25 19:11:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:25.141157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390380fc-c65d-4871-aeaa-3fcdff404c8a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:25.142944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-390380fc-c65d-4871-aeaa-3fcdff404c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:25.201554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:25.261231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390380fc-c65d-4871-aeaa-3fcdff404c8a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:25.339294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:25.339950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:25.340222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:25.340503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:25.342212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:25.463778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:25.477677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:25.479254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52d4bd-3dcb-4156-9b4d-6052b4767058 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:25.499331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 674/1373] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:25.953493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170c33d-24b7-41b8-aee6-b1e4643249ae None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:25.953493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170c33d-24b7-41b8-aee6-b1e4643249ae None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:25.953493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170c33d-24b7-41b8-aee6-b1e4643249ae None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:25.959357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258121-cc48-40c8-96c1-4fdc525476d0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:25.959838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258121-cc48-40c8-96c1-4fdc525476d0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:25.961297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258121-cc48-40c8-96c1-4fdc525476d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:25.965546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 700/1374] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:25 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:26.037162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b4258121-cc48-40c8-96c1-4fdc525476d0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:26.038792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b4258121-cc48-40c8-96c1-4fdc525476d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:26.162152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 675/1375] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:26.217893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170c33d-24b7-41b8-aee6-b1e4643249ae None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:26.220026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9170c33d-24b7-41b8-aee6-b1e4643249ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:26.401058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170c33d-24b7-41b8-aee6-b1e4643249ae None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:26.455910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:26.527869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:26.528525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:26.528803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:26.529089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:26.530779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:26.624131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:26.626037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff7143-3ed4-4d3c-ba2c-a99e405a3950 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:26.645301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 701/1376] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:28.792665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9c98-9b1d-4614-91cd-b98f0746d562 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:28.793329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9c98-9b1d-4614-91cd-b98f0746d562 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:28.793329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9c98-9b1d-4614-91cd-b98f0746d562 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:28.794624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 676/1377] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:28.803597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ca3b-f4fd-49b3-9fb4-1fa7cb4eaf23 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:28.803597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ca3b-f4fd-49b3-9fb4-1fa7cb4eaf23 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:28.803597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ca3b-f4fd-49b3-9fb4-1fa7cb4eaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:28.876462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7570ca3b-f4fd-49b3-9fb4-1fa7cb4eaf23 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:28.877767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7570ca3b-f4fd-49b3-9fb4-1fa7cb4eaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:28.885465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:29.003584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 702/1378] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:29.049543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9c98-9b1d-4614-91cd-b98f0746d562 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:29.050978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b8ca9c98-9b1d-4614-91cd-b98f0746d562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:29.115992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:29.209631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9c98-9b1d-4614-91cd-b98f0746d562 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:29.360685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:29.361565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:29.361954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:29.362327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:29.364178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:29.393368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:29.517427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:29.518983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97fcf4-7e21-4bd6-a82c-05101718a9e4 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:29.543669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 677/1379] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:31.810283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebf2a5-83a1-4cf3-a404-38338892f4b5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:31.811774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebf2a5-83a1-4cf3-a404-38338892f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:31.812264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebf2a5-83a1-4cf3-a404-38338892f4b5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:31.814384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 703/1380] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:31.822125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821e95e-4226-496a-be9f-66d520e4180a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:31.822668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821e95e-4226-496a-be9f-66d520e4180a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:31.823014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821e95e-4226-496a-be9f-66d520e4180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:31.927096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8821e95e-4226-496a-be9f-66d520e4180a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:31.928316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8821e95e-4226-496a-be9f-66d520e4180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:32.032337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:32.049314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 678/1381] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:32.093086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebf2a5-83a1-4cf3-a404-38338892f4b5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:32.094900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-03ebf2a5-83a1-4cf3-a404-38338892f4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:32.257757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:32.270542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebf2a5-83a1-4cf3-a404-38338892f4b5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:32.406431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:32.407102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:32.407385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:32.407663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:32.409353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:32.521716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:32.523428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf09f2d-3fdd-4564-8942-ce0745808af3 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:32.539058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:32.552556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 704/1382] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:34.840765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c392b5-e8c8-41fd-aed9-86bf08986ab7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:34.841438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c392b5-e8c8-41fd-aed9-86bf08986ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:34.841438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c392b5-e8c8-41fd-aed9-86bf08986ab7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:34.842742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 679/1383] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:34.848735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809301-4452-4fba-b855-de3ef7398705 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:34.849831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809301-4452-4fba-b855-de3ef7398705 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:34.849831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809301-4452-4fba-b855-de3ef7398705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:34.922500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-32809301-4452-4fba-b855-de3ef7398705 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:34.923766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-32809301-4452-4fba-b855-de3ef7398705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:35.066205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 705/1384] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:35.116912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c392b5-e8c8-41fd-aed9-86bf08986ab7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:35.118552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-39c392b5-e8c8-41fd-aed9-86bf08986ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:35.335379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c392b5-e8c8-41fd-aed9-86bf08986ab7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:35.415338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:35.497567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:35.498683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:35.499128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:35.499658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:35.503320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:35.651374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:35.653042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02216e-ee36-4256-80b8-54dcf9627c5d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:35.673605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 680/1385] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:37.725680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463aedd-c1d3-4acb-a007-1937c4161962 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.726244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463aedd-c1d3-4acb-a007-1937c4161962 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.726577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463aedd-c1d3-4acb-a007-1937c4161962 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.729172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 706/1386] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:37.735583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d73ba8-5d64-4b8e-a855-a7e515a2df35 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.736112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d73ba8-5d64-4b8e-a855-a7e515a2df35 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.736689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d73ba8-5d64-4b8e-a855-a7e515a2df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.820571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c9d73ba8-5d64-4b8e-a855-a7e515a2df35 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:37.822168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c9d73ba8-5d64-4b8e-a855-a7e515a2df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:37.864123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:37.941887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 681/1387] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:37.994010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463aedd-c1d3-4acb-a007-1937c4161962 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:37.996768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a463aedd-c1d3-4acb-a007-1937c4161962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:38.109536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:38.187379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463aedd-c1d3-4acb-a007-1937c4161962 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:38.314832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:38.315414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:38.315698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:38.315978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:38.317698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:38.373024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:38.429623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:38.431254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e9db4-e0ff-407a-9d25-9691688d64ba service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:38.451608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 707/1388] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:41.449552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38e8dd-6626-4f7f-a81d-8581ed101d95 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:41.450456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38e8dd-6626-4f7f-a81d-8581ed101d95 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:41.450632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38e8dd-6626-4f7f-a81d-8581ed101d95 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:41.452178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 682/1389] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:41.457898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d369-9740-4b79-849b-3493e30fe45a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:41.458421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d369-9740-4b79-849b-3493e30fe45a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:41.458575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d369-9740-4b79-849b-3493e30fe45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:41.530912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cd01d369-9740-4b79-849b-3493e30fe45a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:41.532197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd01d369-9740-4b79-849b-3493e30fe45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:41.634386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 708/1390] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:41.678370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38e8dd-6626-4f7f-a81d-8581ed101d95 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:41.680062 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ee38e8dd-6626-4f7f-a81d-8581ed101d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:41.703791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f3d13-89f5-4a2e-a148-8e4514e714b4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:41.704358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f3d13-89f5-4a2e-a148-8e4514e714b4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:41.704717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f3d13-89f5-4a2e-a148-8e4514e714b4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:41.706301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 709/1391] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:41.711582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bd91d-6b80-4ee2-95cb-ab0e64dfaf1c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:41.712405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bd91d-6b80-4ee2-95cb-ab0e64dfaf1c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:41.712405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bd91d-6b80-4ee2-95cb-ab0e64dfaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:41.736604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:41.813584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-547bd91d-6b80-4ee2-95cb-ab0e64dfaf1c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:41.815336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-547bd91d-6b80-4ee2-95cb-ab0e64dfaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:41.862108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38e8dd-6626-4f7f-a81d-8581ed101d95 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:41.881324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:41.932577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 710/1392] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:41.992095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18d65-46df-4723-9f90-18b5615dca71 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:41.992373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18d65-46df-4723-9f90-18b5615dca71 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:41.992689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18d65-46df-4723-9f90-18b5615dca71 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:41.994568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 711/1393] 10.222.0.113 () {54 vars in 971 bytes} [Mon Jul 25 19:11:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:41.999982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:42.000266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:42.000532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:42.095604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] MFA Rules not processed for user `e0573ae51c744a45aeca013357431eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:42.097035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:42.124340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:42.125019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:42.125399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:42.125636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:42.127347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:42.141843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:42.196655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 712/1394] 10.222.0.113 () {58 vars in 1068 bytes} [Mon Jul 25 19:11:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:42.204368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:42.213688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7bb55-c5a7-48f9-a56e-b5cdb4d25352 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:42.226481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:42.228511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646436-02a3-4199-9283-f61c86b48b41 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:42.247606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 683/1395] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:42.301788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:42.302833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:42.303421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:42.303857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:42.306131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:42.444520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:42.449845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:42.452692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cbf95-c80c-463a-91b2-679d3c4997ef service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:42.495333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 713/1396] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:43.271462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5105d-92c7-437b-ae9d-7fb718a4378d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:43.272001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5105d-92c7-437b-ae9d-7fb718a4378d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:43.272458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5105d-92c7-437b-ae9d-7fb718a4378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:43.311659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:43.381061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f6c5105d-92c7-437b-ae9d-7fb718a4378d None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:43.382905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f6c5105d-92c7-437b-ae9d-7fb718a4378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:43.492159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 684/1397] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:11:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:43.539260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280aff8-eade-4d43-9daa-4895707e1ca4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:43.539839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280aff8-eade-4d43-9daa-4895707e1ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:43.539999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280aff8-eade-4d43-9daa-4895707e1ca4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:43.541579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 714/1398] 10.222.0.113 () {54 vars in 948 bytes} [Mon Jul 25 19:11:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:43.548948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088931-1fe1-4223-bb06-367cba0a0629 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:43.549415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088931-1fe1-4223-bb06-367cba0a0629 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:43.549835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088931-1fe1-4223-bb06-367cba0a0629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:43.658393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ea088931-1fe1-4223-bb06-367cba0a0629 None None] MFA Rules not processed for user `d2e01af3550b4e638343e176888a21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:43.659618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ea088931-1fe1-4223-bb06-367cba0a0629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:43.716275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:43.775867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 685/1399] 10.222.0.113 () {58 vars in 1045 bytes} [Mon Jul 25 19:11:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:43.785556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280aff8-eade-4d43-9daa-4895707e1ca4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:43.787173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0280aff8-eade-4d43-9daa-4895707e1ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:43.943615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280aff8-eade-4d43-9daa-4895707e1ca4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:44.021852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:44.061595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:44.062286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:44.062642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:44.063166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:44.064735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:44.164197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:44.166220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96222b3-95cf-4294-b911-b04429ca3a2d service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:44.175234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 715/1400] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:11:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:11:44.361363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fbec1-7450-4bec-99fd-5c7b0e3405f8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:44.362224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fbec1-7450-4bec-99fd-5c7b0e3405f8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:44.362224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fbec1-7450-4bec-99fd-5c7b0e3405f8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:44.363445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 686/1401] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:44.368795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cb78-1cc0-4748-8566-039a0a4f3047 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:44.369085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cb78-1cc0-4748-8566-039a0a4f3047 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:44.369399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516cb78-1cc0-4748-8566-039a0a4f3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:44.447612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4516cb78-1cc0-4748-8566-039a0a4f3047 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:44.449277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4516cb78-1cc0-4748-8566-039a0a4f3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:44.520161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:44.577894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 716/1402] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:44.626887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fbec1-7450-4bec-99fd-5c7b0e3405f8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:44.628462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f14fbec1-7450-4bec-99fd-5c7b0e3405f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:44.806313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fbec1-7450-4bec-99fd-5c7b0e3405f8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:44.840338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:44.977066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:44.978536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:44.978830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:44.979109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:44.980849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:45.108907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:45.110578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30c60-8397-4072-9f62-a3fcb9645b65 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:45.141362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 687/1403] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:47.287691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115bdf-d554-4097-9586-f39d14c4ffe8 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:47.288246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115bdf-d554-4097-9586-f39d14c4ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:47.288341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115bdf-d554-4097-9586-f39d14c4ffe8 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:47.290470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 717/1404] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:47.298553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5b76-f683-4c54-a52f-1cf2e811d52c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:47.299235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5b76-f683-4c54-a52f-1cf2e811d52c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:47.299762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5b76-f683-4c54-a52f-1cf2e811d52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:47.377067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:47.439925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5a9a5b76-f683-4c54-a52f-1cf2e811d52c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:47.441535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a9a5b76-f683-4c54-a52f-1cf2e811d52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:47.605178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 688/1405] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:47.728657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115bdf-d554-4097-9586-f39d14c4ffe8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:47.729594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8e115bdf-d554-4097-9586-f39d14c4ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:47.956180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115bdf-d554-4097-9586-f39d14c4ffe8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:48.023724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:48.153536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:48.154542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:48.155010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:48.155432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:48.157945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:48.294537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:48.296101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1e0f2-5c23-4199-8565-7b48e3fb2e9e service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:48.317019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 718/1406] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:51.014196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c5771-295a-42ed-9937-87464ad6af30 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:51.014951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c5771-295a-42ed-9937-87464ad6af30 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:51.014951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c5771-295a-42ed-9937-87464ad6af30 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:51.016125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 689/1407] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:11:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:51.023209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac21e1-f533-4129-9056-799015b4fce0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:51.024021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac21e1-f533-4129-9056-799015b4fce0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:51.024183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac21e1-f533-4129-9056-799015b4fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:51.107880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:51.120988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a9ac21e1-f533-4129-9056-799015b4fce0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:51.122256 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a9ac21e1-f533-4129-9056-799015b4fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:51.251351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 719/1408] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:51.296010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c5771-295a-42ed-9937-87464ad6af30 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:51.297615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a64c5771-295a-42ed-9937-87464ad6af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:51.432630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:51.506117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c5771-295a-42ed-9937-87464ad6af30 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:51.642547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:51.643442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:51.643534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:51.643740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:51.645483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:51.721672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:51.756265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:51.758573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df06dd0-6da5-4698-9eba-6cd7356dd019 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:51.785567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 690/1409] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:12:01.249021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=44 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:01.780750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=14 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:07.598266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da29ecd-06ab-49c4-a9f2-7d342e31762f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:07.598917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da29ecd-06ab-49c4-a9f2-7d342e31762f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:07.598917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da29ecd-06ab-49c4-a9f2-7d342e31762f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:07.600214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 720/1410] 10.222.0.113 () {54 vars in 923 bytes} [Mon Jul 25 19:12:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:07.606001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165685-c8ea-4f41-9af0-90ab296459b6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:07.606491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165685-c8ea-4f41-9af0-90ab296459b6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:07.606585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165685-c8ea-4f41-9af0-90ab296459b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:07.688249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5a165685-c8ea-4f41-9af0-90ab296459b6 None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:07.689532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a165685-c8ea-4f41-9af0-90ab296459b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:07.806083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 691/1411] 10.222.0.113 () {58 vars in 1020 bytes} [Mon Jul 25 19:12:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:07.821131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b8a31-b839-403f-a3bf-936f5b57ded3 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:07.821427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b8a31-b839-403f-a3bf-936f5b57ded3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:07.821723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b8a31-b839-403f-a3bf-936f5b57ded3 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:07.823119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 721/1412] 10.222.0.113 () {54 vars in 923 bytes} [Mon Jul 25 19:12:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:07.827933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f35c-47e5-4d99-ae44-1ad51fcc1f06 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:07.828223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f35c-47e5-4d99-ae44-1ad51fcc1f06 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:07.828500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f35c-47e5-4d99-ae44-1ad51fcc1f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:07.905974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:07.908964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3db0f35c-47e5-4d99-ae44-1ad51fcc1f06 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:07.910964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3db0f35c-47e5-4d99-ae44-1ad51fcc1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:08.032250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 692/1413] 10.222.0.113 () {58 vars in 1020 bytes} [Mon Jul 25 19:12:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:10.508285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28b1a7-ca85-48b1-a3b5-b7cb71319911 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:10.508842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28b1a7-ca85-48b1-a3b5-b7cb71319911 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:10.508842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28b1a7-ca85-48b1-a3b5-b7cb71319911 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:10.510329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:10.516122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc2f9-d026-4985-b1c3-655b2b245ab6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:10.516624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc2f9-d026-4985-b1c3-655b2b245ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:10.516716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cc2f9-d026-4985-b1c3-655b2b245ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:10.591310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8e9cc2f9-d026-4985-b1c3-655b2b245ab6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:10.592533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e9cc2f9-d026-4985-b1c3-655b2b245ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:10.661708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:10.714472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:10.759844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28b1a7-ca85-48b1-a3b5-b7cb71319911 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:10.761420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fd28b1a7-ca85-48b1-a3b5-b7cb71319911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:10.915571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28b1a7-ca85-48b1-a3b5-b7cb71319911 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:10.995434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:11.048275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:11.048275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:11.048745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:11.048745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:11.050568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:11.159042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:11.160662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4b253-bf40-4ae5-98c0-238039c932c0 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:11.180853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 723/1416] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:12.095797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79002fb-b4b3-4f11-ab17-82caba679da2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:12.096412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79002fb-b4b3-4f11-ab17-82caba679da2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:12.096412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79002fb-b4b3-4f11-ab17-82caba679da2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:12.098422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:12.105811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff639e9-a385-4cd4-9ef1-6d09447b1880 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:12.106630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff639e9-a385-4cd4-9ef1-6d09447b1880 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:12.106781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff639e9-a385-4cd4-9ef1-6d09447b1880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:12.190896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-eff639e9-a385-4cd4-9ef1-6d09447b1880 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:12.192138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eff639e9-a385-4cd4-9ef1-6d09447b1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:12.226243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:12.299470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:12.450214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79002fb-b4b3-4f11-ab17-82caba679da2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:12.452610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f79002fb-b4b3-4f11-ab17-82caba679da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:12.633975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79002fb-b4b3-4f11-ab17-82caba679da2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:12.684469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:12.771503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:12.772151 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:12.772427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:12.772987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:12.775045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:12.873723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:12.875316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9aea-9a68-47f9-b881-97fdc2ce72a5 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:12.896825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 695/1419] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:13.790260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7b89b-8575-44d6-802a-a6c14967d805 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:13.790953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7b89b-8575-44d6-802a-a6c14967d805 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:13.791063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7b89b-8575-44d6-802a-a6c14967d805 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:13.793514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:13 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:13.803654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956243-4b14-42a4-a793-1a57d84aacd9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:13.804323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956243-4b14-42a4-a793-1a57d84aacd9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:13.804520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956243-4b14-42a4-a793-1a57d84aacd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:13.869762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:13.894080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cf956243-4b14-42a4-a793-1a57d84aacd9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:13.895306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cf956243-4b14-42a4-a793-1a57d84aacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:14.012862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:14.170862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7b89b-8575-44d6-802a-a6c14967d805 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:14.172411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-72f7b89b-8575-44d6-802a-a6c14967d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:14.347308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7b89b-8575-44d6-802a-a6c14967d805 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:14.361475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:14.486198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:14.486851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:14.487116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:14.487382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:14.489096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:14.594488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:14.596137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ea1d4-4cfc-41a5-aba7-aa595f6d4f5a service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:14.626446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 726/1422] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:15.520230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fd2d-be86-44f9-b782-175c69d5e66e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:15.520829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fd2d-be86-44f9-b782-175c69d5e66e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:15.520829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fd2d-be86-44f9-b782-175c69d5e66e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:15.522248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:15.528791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a42e3-e349-484e-982e-90ec9630f860 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:15.529267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a42e3-e349-484e-982e-90ec9630f860 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:15.529380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a42e3-e349-484e-982e-90ec9630f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:15.559583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:15.628992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-769a42e3-e349-484e-982e-90ec9630f860 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:15.630185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-769a42e3-e349-484e-982e-90ec9630f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:15.749215 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:15.901501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67fd2d-be86-44f9-b782-175c69d5e66e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:15.903670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f67fd2d-be86-44f9-b782-175c69d5e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:16.030077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:16.068018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67fd2d-be86-44f9-b782-175c69d5e66e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:16.201883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:16.202546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:16.202831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:16.203103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:16.204852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:16.292953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:16.308327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:16.310063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6262cc-7f84-4b41-84a0-02e9ff7dac16 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:16.332748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 698/1425] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:17.243671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80cf7-0e37-4993-8492-2f2831c55110 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:17.244283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80cf7-0e37-4993-8492-2f2831c55110 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:17.244283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80cf7-0e37-4993-8492-2f2831c55110 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:17.245652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:17.250992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20784fe-35fb-4ffa-9e28-e592a5fe2eba None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:17.251532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20784fe-35fb-4ffa-9e28-e592a5fe2eba None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:17.251532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20784fe-35fb-4ffa-9e28-e592a5fe2eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:17.342028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f20784fe-35fb-4ffa-9e28-e592a5fe2eba None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:17.343262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f20784fe-35fb-4ffa-9e28-e592a5fe2eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:17.467273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:17.621180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80cf7-0e37-4993-8492-2f2831c55110 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:17.623635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b7e80cf7-0e37-4993-8492-2f2831c55110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:17.720244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:17.796997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80cf7-0e37-4993-8492-2f2831c55110 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:17.934505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:17.934505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:17.934505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:17.935026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:17.936477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:17.989595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:18.034588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:18.036230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6ca6f-d8ab-4915-9a9a-6c4a5477f8e4 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:18.055354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 729/1428] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:18.882194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c604-1d62-4c8f-b44f-d650929836f7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:18.883118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c604-1d62-4c8f-b44f-d650929836f7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:18.883118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c604-1d62-4c8f-b44f-d650929836f7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:18.885381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:18.890574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ccf3e-8dad-47b2-b5ac-f56e456b662d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:18.891025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ccf3e-8dad-47b2-b5ac-f56e456b662d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:18.891142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ccf3e-8dad-47b2-b5ac-f56e456b662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:18.983081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2d7ccf3e-8dad-47b2-b5ac-f56e456b662d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:18.984232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2d7ccf3e-8dad-47b2-b5ac-f56e456b662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:19.097682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:19.259870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c604-1d62-4c8f-b44f-d650929836f7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:19.261355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2dc1c604-1d62-4c8f-b44f-d650929836f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:19.313434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:19.433891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c604-1d62-4c8f-b44f-d650929836f7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:19.565787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:19.566548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:19.566919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:19.567319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:19.569838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:19.578915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:19.670812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:19.672475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240517-0c27-4307-8c0e-fe51387dcbad service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:19.697375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 701/1431] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:20.494404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4046ae-943a-4994-a47d-e2f625a202d7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:20.495052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4046ae-943a-4994-a47d-e2f625a202d7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:20.495052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4046ae-943a-4994-a47d-e2f625a202d7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:20.496343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:20.501670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248a9e-fa8d-48c8-85bd-6d0f8db09716 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:20.502196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248a9e-fa8d-48c8-85bd-6d0f8db09716 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:20.502196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248a9e-fa8d-48c8-85bd-6d0f8db09716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:20.602101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a1248a9e-fa8d-48c8-85bd-6d0f8db09716 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:20.603365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a1248a9e-fa8d-48c8-85bd-6d0f8db09716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:20.686165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:20.717778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:20.867980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4046ae-943a-4994-a47d-e2f625a202d7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:20.870470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4e4046ae-943a-4994-a47d-e2f625a202d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:20.898479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:21.037168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4046ae-943a-4994-a47d-e2f625a202d7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:21.133867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:21.162167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:21.163069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:21.163598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:21.163598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:21.165329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:21.260198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:21.261854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91e725-6fc7-4e1a-89d3-8fd08fe22172 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:21.282826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 732/1434] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:22.107538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708238a-63b3-4790-aa67-d2585e9441f9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:22.108383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708238a-63b3-4790-aa67-d2585e9441f9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:22.108383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708238a-63b3-4790-aa67-d2585e9441f9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:22.110572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:22.119173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b532-7e57-4d01-b4ce-3184e1b2c29d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:22.119951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b532-7e57-4d01-b4ce-3184e1b2c29d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:22.120085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b532-7e57-4d01-b4ce-3184e1b2c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:22.205402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6267b532-7e57-4d01-b4ce-3184e1b2c29d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:22.206628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6267b532-7e57-4d01-b4ce-3184e1b2c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:22.251845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:22.311326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:22.461898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708238a-63b3-4790-aa67-d2585e9441f9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:22.464367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f708238a-63b3-4790-aa67-d2585e9441f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:22.632728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708238a-63b3-4790-aa67-d2585e9441f9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:22.693767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:22.767133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:22.767789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:22.768073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:22.768344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:22.770044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:22.868893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:22.870541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe940338-f851-4ee6-b317-13ebdf054740 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:22.889792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 704/1437] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:23.697528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32248566-ce6b-47d7-b1a0-d974a58ed561 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:23.698048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32248566-ce6b-47d7-b1a0-d974a58ed561 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:23.698048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32248566-ce6b-47d7-b1a0-d974a58ed561 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:23.699476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:23.704649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7538d-c8fd-46f6-a733-64c547d65fcb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:23.705075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7538d-c8fd-46f6-a733-64c547d65fcb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:23.705218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7538d-c8fd-46f6-a733-64c547d65fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:23.788110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d3a7538d-c8fd-46f6-a733-64c547d65fcb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:23.789484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d3a7538d-c8fd-46f6-a733-64c547d65fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:23.791715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:23.892930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:24.043417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32248566-ce6b-47d7-b1a0-d974a58ed561 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:24.046204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-32248566-ce6b-47d7-b1a0-d974a58ed561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:24.211333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32248566-ce6b-47d7-b1a0-d974a58ed561 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:24.242221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:24.332641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:24.333338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:24.333623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:24.333895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:24.336028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:24.433716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:24.435350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f3384-da3f-40e7-b549-055fdbde5699 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:24.454851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 735/1440] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:26.333177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281072c2-83a2-4e6a-9a00-acc88ffe69e6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:26.333781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281072c2-83a2-4e6a-9a00-acc88ffe69e6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:26.333781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281072c2-83a2-4e6a-9a00-acc88ffe69e6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:26.335765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:26.341365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d3c7-12b8-4faa-823f-b07b7168357a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:26.341860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d3c7-12b8-4faa-823f-b07b7168357a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:26.341860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d3c7-12b8-4faa-823f-b07b7168357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:26.387665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:26.416672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6ab1d3c7-12b8-4faa-823f-b07b7168357a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:26.418574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ab1d3c7-12b8-4faa-823f-b07b7168357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:26.546227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:26.593871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281072c2-83a2-4e6a-9a00-acc88ffe69e6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:26.595617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-281072c2-83a2-4e6a-9a00-acc88ffe69e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:26.713136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281072c2-83a2-4e6a-9a00-acc88ffe69e6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:26.752498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:26.796463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:26.797031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:26.797342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:26.797619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:26.799274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:26.951486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:26.952975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08eff4-36bc-4a03-b27b-483cbb67c945 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:26.980483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 707/1443] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:29.176272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ff992-93e6-4a67-bb87-87d68a0c04fc None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:29.176842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ff992-93e6-4a67-bb87-87d68a0c04fc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:29.176842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ff992-93e6-4a67-bb87-87d68a0c04fc None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:29.178561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:29.186403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2cec7-6592-4f16-9634-1145c8f89fc0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:29.187089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2cec7-6592-4f16-9634-1145c8f89fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:29.187222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2cec7-6592-4f16-9634-1145c8f89fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:29.281055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-52f2cec7-6592-4f16-9634-1145c8f89fc0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:29.282825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52f2cec7-6592-4f16-9634-1145c8f89fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:29.301021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:29.404930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:29.446228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ff992-93e6-4a67-bb87-87d68a0c04fc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:29.447780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-502ff992-93e6-4a67-bb87-87d68a0c04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:29.562377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ff992-93e6-4a67-bb87-87d68a0c04fc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:29.576970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:29.653786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:29.654466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:29.654687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:29.654993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:29.656661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:29.782562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:29.783923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23366ba-ca95-4e21-950e-3a72a72b9291 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:29.804329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 738/1446] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:32.130323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b79301-0c7d-43a2-a495-40d52e5c80f3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:32.130890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b79301-0c7d-43a2-a495-40d52e5c80f3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:32.130890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b79301-0c7d-43a2-a495-40d52e5c80f3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:32.132316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:32.138963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0624c-33a8-40fc-ba14-2953cb714c5b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:32.139441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0624c-33a8-40fc-ba14-2953cb714c5b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:32.139541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0624c-33a8-40fc-ba14-2953cb714c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:32.197779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:32.218364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-83b0624c-33a8-40fc-ba14-2953cb714c5b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:32.219592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-83b0624c-33a8-40fc-ba14-2953cb714c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:32.328791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:32.373390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b79301-0c7d-43a2-a495-40d52e5c80f3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:32.374965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-03b79301-0c7d-43a2-a495-40d52e5c80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:32.496722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b79301-0c7d-43a2-a495-40d52e5c80f3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:32.539660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:32.578481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:32.579147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:32.579427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:32.579686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:32.581389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:32.708931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:32.711036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4381c4e-7c32-415f-99de-43c489ad2071 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:32.731778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 710/1449] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:34.913578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1b157-138b-4dbc-baea-815cad8dcdc6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:34.914207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1b157-138b-4dbc-baea-815cad8dcdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:34.914207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1b157-138b-4dbc-baea-815cad8dcdc6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:34.915537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:34.922402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eabc0-40a4-4d0e-84ae-000f49820539 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:34.922892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eabc0-40a4-4d0e-84ae-000f49820539 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:34.923008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eabc0-40a4-4d0e-84ae-000f49820539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:35.002047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c03eabc0-40a4-4d0e-84ae-000f49820539 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:35.003379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c03eabc0-40a4-4d0e-84ae-000f49820539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:35.026480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:35.118213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:35.162707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1b157-138b-4dbc-baea-815cad8dcdc6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:35.164394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-48e1b157-138b-4dbc-baea-815cad8dcdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:35.289600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1b157-138b-4dbc-baea-815cad8dcdc6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:35.311566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:35.384821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:35.385527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:35.385809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:35.386258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:35.387772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:35.541835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:35.543222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade77d12-663f-4096-8a90-c6cc83c15b09 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:35.569619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 741/1452] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:37.766881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e8c1-5212-49ba-8fb5-06f0dabfe007 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:37.767738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e8c1-5212-49ba-8fb5-06f0dabfe007 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:37.767738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e8c1-5212-49ba-8fb5-06f0dabfe007 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:37.770124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:37.776746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306514-7995-4fec-8e6f-6ba1db7c3831 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:37.777426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306514-7995-4fec-8e6f-6ba1db7c3831 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:37.777544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306514-7995-4fec-8e6f-6ba1db7c3831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:37.854572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:37.857485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-28306514-7995-4fec-8e6f-6ba1db7c3831 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:37.859225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-28306514-7995-4fec-8e6f-6ba1db7c3831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:37.965151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:38.005568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e8c1-5212-49ba-8fb5-06f0dabfe007 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:38.007741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3cc7e8c1-5212-49ba-8fb5-06f0dabfe007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:38.127439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e8c1-5212-49ba-8fb5-06f0dabfe007 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:38.180291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:38.214481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:38.215141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:38.215487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:38.215661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:38.217420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:38.342655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:38.344105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2526b67-33bc-43e6-95cd-0fbc87c3433b service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:38.362782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 713/1455] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:40.451860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6f25-c304-4290-87ee-03d677688ac7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:40.452421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6f25-c304-4290-87ee-03d677688ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:40.452421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6f25-c304-4290-87ee-03d677688ac7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:40.453805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:40.459858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b10c-2978-46b4-ad80-404dfd464322 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:40.460323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b10c-2978-46b4-ad80-404dfd464322 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:40.460416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b10c-2978-46b4-ad80-404dfd464322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:40.541760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-be01b10c-2978-46b4-ad80-404dfd464322 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:40.542981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-be01b10c-2978-46b4-ad80-404dfd464322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:40.577317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:40.657560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:40.695278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6f25-c304-4290-87ee-03d677688ac7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:40.696877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7ac6f25-c304-4290-87ee-03d677688ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:40.815618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6f25-c304-4290-87ee-03d677688ac7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:40.847173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:40.906834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:40.907650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:40.907931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:40.908243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:40.909974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:41.029949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:41.031406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f81eb3-0b47-4adc-a57f-a8b771c3b6ad service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:41.051435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 744/1458] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:43.091426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa966a0-cfa4-47cf-8111-2d02fd66c626 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:43.092048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa966a0-cfa4-47cf-8111-2d02fd66c626 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:43.092048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa966a0-cfa4-47cf-8111-2d02fd66c626 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:43.093406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:43.100365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb074a-5224-4f29-9d20-d62e69d7123f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:43.100826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb074a-5224-4f29-9d20-d62e69d7123f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:43.100959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb074a-5224-4f29-9d20-d62e69d7123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:43.174873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-40eb074a-5224-4f29-9d20-d62e69d7123f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:43.176004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-40eb074a-5224-4f29-9d20-d62e69d7123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:43.185223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:43.288190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:43.326246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa966a0-cfa4-47cf-8111-2d02fd66c626 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:43.327795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2aa966a0-cfa4-47cf-8111-2d02fd66c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:43.444185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa966a0-cfa4-47cf-8111-2d02fd66c626 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:43.515009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:43.535509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:43.536163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:43.536442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:43.536736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:43.538534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:43.678979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:43.680434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e4aed-8544-4d4c-ae2e-832b7aa0a04e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:43.702015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 716/1461] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:45.811464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3d03a-5320-4741-b1ce-a4d7b0ddfd56 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:45.812491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3d03a-5320-4741-b1ce-a4d7b0ddfd56 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:45.812491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3d03a-5320-4741-b1ce-a4d7b0ddfd56 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:45.814713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:45 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:45.824504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa18ee-f48c-4dae-9ca1-dbca25feee01 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:45.825323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa18ee-f48c-4dae-9ca1-dbca25feee01 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:45.825479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa18ee-f48c-4dae-9ca1-dbca25feee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:45.904830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-57fa18ee-f48c-4dae-9ca1-dbca25feee01 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:45.906067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-57fa18ee-f48c-4dae-9ca1-dbca25feee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:45.946380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:46.025387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:46.063462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3d03a-5320-4741-b1ce-a4d7b0ddfd56 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:46.065036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5cb3d03a-5320-4741-b1ce-a4d7b0ddfd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:46.179712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3d03a-5320-4741-b1ce-a4d7b0ddfd56 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:46.222891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:46.261544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:46.262254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:46.262587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:46.262908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:46.264750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:46.391318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:46.393342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f64f1-4fd4-4d0b-9c07-2b1eb7b6516f service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:46.413147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 747/1464] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:48.471471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8b29b-71ff-4e36-96a9-1aa6a8bf8a16 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:48.472351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8b29b-71ff-4e36-96a9-1aa6a8bf8a16 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:48.472351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8b29b-71ff-4e36-96a9-1aa6a8bf8a16 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:48.474689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:48 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:48.482900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a789-ddf4-428b-bbde-17303c7b683a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:48.483407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a789-ddf4-428b-bbde-17303c7b683a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:48.483407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a789-ddf4-428b-bbde-17303c7b683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:48.556728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6cc0a789-ddf4-428b-bbde-17303c7b683a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:48.558110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6cc0a789-ddf4-428b-bbde-17303c7b683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:48.578141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:48.667224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:12:48.706923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8b29b-71ff-4e36-96a9-1aa6a8bf8a16 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:48.709215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8b8b29b-71ff-4e36-96a9-1aa6a8bf8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:48.837759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8b29b-71ff-4e36-96a9-1aa6a8bf8a16 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:48.910941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:48.919175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:48.919765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:48.920051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:48.920327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:48.922113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:49.051839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:49.053330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e9667-3c25-4860-b017-7dbcca0ae651 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:49.075709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 719/1467] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:51.125837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18ace-e9ad-4569-aa45-fd09b33bee65 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:51.126744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18ace-e9ad-4569-aa45-fd09b33bee65 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:51.126744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18ace-e9ad-4569-aa45-fd09b33bee65 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:51.128867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:51.137517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a4bcc-eb4e-4471-a361-9b9860439609 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:51.137986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a4bcc-eb4e-4471-a361-9b9860439609 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:51.138093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a4bcc-eb4e-4471-a361-9b9860439609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:51.221895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ec4a4bcc-eb4e-4471-a361-9b9860439609 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:51.223108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec4a4bcc-eb4e-4471-a361-9b9860439609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:51.273974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:51.331625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:51.371861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18ace-e9ad-4569-aa45-fd09b33bee65 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:51.373703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f5a18ace-e9ad-4569-aa45-fd09b33bee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:51.487801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18ace-e9ad-4569-aa45-fd09b33bee65 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:51.537649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:51.566046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:51.566713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:51.566995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:51.567272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:51.569069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:51.706486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:51.709039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb43d8-11c0-455e-beee-ec1f4c5e5ce8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:51.729380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 750/1470] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:01.329655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=22 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:01.726392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=66 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:11.374621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542e87-958a-4d51-8d6f-d1c1185e39f0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:11.375232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542e87-958a-4d51-8d6f-d1c1185e39f0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:11.375232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542e87-958a-4d51-8d6f-d1c1185e39f0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:11.376675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 721/1471] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:11.382492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2736a3-5d23-48a1-8f8b-fe4555de37cb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:11.382984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2736a3-5d23-48a1-8f8b-fe4555de37cb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:11.382984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2736a3-5d23-48a1-8f8b-fe4555de37cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:11.457099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1d2736a3-5d23-48a1-8f8b-fe4555de37cb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:11.459178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1d2736a3-5d23-48a1-8f8b-fe4555de37cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:11.572018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 751/1472] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:11.658693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b60d2-a38f-45dd-8dd7-fb9644bf7139 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:11.658987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b60d2-a38f-45dd-8dd7-fb9644bf7139 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:11.659279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b60d2-a38f-45dd-8dd7-fb9644bf7139 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:11.660814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 722/1473] 10.222.0.113 () {54 vars in 971 bytes} [Mon Jul 25 19:13:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:11.665823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23467d-2ae4-4a75-8d2b-3f50d3928824 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:11.666106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23467d-2ae4-4a75-8d2b-3f50d3928824 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:11.666384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23467d-2ae4-4a75-8d2b-3f50d3928824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:11.757637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5b23467d-2ae4-4a75-8d2b-3f50d3928824 None None] MFA Rules not processed for user `e0573ae51c744a45aeca013357431eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:11.758880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b23467d-2ae4-4a75-8d2b-3f50d3928824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:11.784261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:11.843280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 752/1474] 10.222.0.113 () {58 vars in 1068 bytes} [Mon Jul 25 19:13:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:11.851958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b60d2-a38f-45dd-8dd7-fb9644bf7139 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:11.853570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-346b60d2-a38f-45dd-8dd7-fb9644bf7139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:11.972824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b60d2-a38f-45dd-8dd7-fb9644bf7139 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:12.069994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:12.070657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:12.070942 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:12.071221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:12.072894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:12.131236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:12.189090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:12.190572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab6b4e-86f0-4a55-aa89-ea578d260b72 service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:12.210793 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 723/1475] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:13:14.337158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01720b2-10aa-45d5-a089-cf6d2ed203ca None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:14.337762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01720b2-10aa-45d5-a089-cf6d2ed203ca None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:14.337762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01720b2-10aa-45d5-a089-cf6d2ed203ca None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:14.339091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 753/1476] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:14.345696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494999eb-3a3d-4e62-8592-be6bd5f681bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:14.346133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494999eb-3a3d-4e62-8592-be6bd5f681bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:14.346245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494999eb-3a3d-4e62-8592-be6bd5f681bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:14.425258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-494999eb-3a3d-4e62-8592-be6bd5f681bb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:14.426540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-494999eb-3a3d-4e62-8592-be6bd5f681bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:14.531818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 724/1477] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:14.556067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01720b2-10aa-45d5-a089-cf6d2ed203ca None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:14.558491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c01720b2-10aa-45d5-a089-cf6d2ed203ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:14.708439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01720b2-10aa-45d5-a089-cf6d2ed203ca None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:14.768037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:14.819204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:14.819882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:14.820163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:14.820440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:14.821182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:14.823042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:13:14.823042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:13:14.823042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:13:14.824205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd2dda-4847-4f9e-82b0-0d43ef266325 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:14.847569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 754/1478] 10.222.0.113 () {56 vars in 1113 bytes} [Mon Jul 25 19:13:14 2022] GET /identity/v3/projects => generated 2562 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:13:16.908577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44947f-67e8-4adc-b5ab-7c0e56e6521e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:16.909554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44947f-67e8-4adc-b5ab-7c0e56e6521e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:16.909554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44947f-67e8-4adc-b5ab-7c0e56e6521e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:16.911621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 725/1479] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:16 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:16.918146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02960f-6ce3-46bb-afa1-485638d8103b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:16.918648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02960f-6ce3-46bb-afa1-485638d8103b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:16.918752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02960f-6ce3-46bb-afa1-485638d8103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:16.997925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2e02960f-6ce3-46bb-afa1-485638d8103b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:16.999083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2e02960f-6ce3-46bb-afa1-485638d8103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:17.101184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 755/1480] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:17.148352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44947f-67e8-4adc-b5ab-7c0e56e6521e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:17.150119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec44947f-67e8-4adc-b5ab-7c0e56e6521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:17.163453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:17.315661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44947f-67e8-4adc-b5ab-7c0e56e6521e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:17.415227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:17.450912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:17.451568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:17.451854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:17.452133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:17.453895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:17.554897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:17.556511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3d8f0-5107-4540-8fca-2906062762e3 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:17.575202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 726/1481] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:19.790051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca460fb-9fd1-4b41-842d-52aa3fca33cc None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:19.790631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca460fb-9fd1-4b41-842d-52aa3fca33cc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:19.790631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca460fb-9fd1-4b41-842d-52aa3fca33cc None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:19.792748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 756/1482] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:19.801400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eb3f0-3dbe-4376-bbed-bbfd228af6d7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:19.801827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eb3f0-3dbe-4376-bbed-bbfd228af6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:19.802105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eb3f0-3dbe-4376-bbed-bbfd228af6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:19.886048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-193eb3f0-3dbe-4376-bbed-bbfd228af6d7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:19.887285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-193eb3f0-3dbe-4376-bbed-bbfd228af6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:19.946594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:20.003581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 727/1483] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:20.041710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca460fb-9fd1-4b41-842d-52aa3fca33cc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:20.043271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fca460fb-9fd1-4b41-842d-52aa3fca33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:20.071079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:20.169389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca460fb-9fd1-4b41-842d-52aa3fca33cc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:20.272823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:20.273443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:20.273727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:20.274004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:20.275748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:20.371931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:20.417949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:20.419404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae85e9-207b-4f85-a941-cba54aa8a9a1 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:20.439564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 757/1484] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:22.578383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd5a8f-7463-4f26-ac7f-2e7852cf53da None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:22.578957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd5a8f-7463-4f26-ac7f-2e7852cf53da None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:22.578957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd5a8f-7463-4f26-ac7f-2e7852cf53da None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:22.581188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 728/1485] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:22.588427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6e59-1a1a-46d6-95ef-27312ec4c1b0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:22.589186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6e59-1a1a-46d6-95ef-27312ec4c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:22.589345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6e59-1a1a-46d6-95ef-27312ec4c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:22.667103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-896e6e59-1a1a-46d6-95ef-27312ec4c1b0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:22.668363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-896e6e59-1a1a-46d6-95ef-27312ec4c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:22.784767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 758/1486] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:22.827672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd5a8f-7463-4f26-ac7f-2e7852cf53da None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:22.830208 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-77dd5a8f-7463-4f26-ac7f-2e7852cf53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:22.949533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd5a8f-7463-4f26-ac7f-2e7852cf53da None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:23.029214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:23.031043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:23.031730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:23.032033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:23.032318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:23.034620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:23.150988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:23.152350 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad846b-7cf9-4824-b3d9-6fa213026a69 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:23.172360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 729/1487] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:25.257994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8582d-2325-4c56-b87c-eb48af54aa4b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:25.258622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8582d-2325-4c56-b87c-eb48af54aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:25.258622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8582d-2325-4c56-b87c-eb48af54aa4b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:25.259917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 759/1488] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:25.266242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ea25b-96e9-47ff-bc9c-332c6399b2cb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:25.266989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ea25b-96e9-47ff-bc9c-332c6399b2cb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:25.267083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ea25b-96e9-47ff-bc9c-332c6399b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:25.338159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3c6ea25b-96e9-47ff-bc9c-332c6399b2cb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:25.339391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3c6ea25b-96e9-47ff-bc9c-332c6399b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:25.398817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:25.445316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 730/1489] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:25.490298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8582d-2325-4c56-b87c-eb48af54aa4b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:25.491873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9cf8582d-2325-4c56-b87c-eb48af54aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:25.532025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:25.614147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8582d-2325-4c56-b87c-eb48af54aa4b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:25.693800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:25.694454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:25.694734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:25.695006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:25.696665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:25.792070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:25.824013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:25.825526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da454c93-9092-4b8e-9ea7-ca03f6ef5906 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:25.846149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 760/1490] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:28.075950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f34a3-2557-498f-a1f8-a912e051c58b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:28.076529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f34a3-2557-498f-a1f8-a912e051c58b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:28.076529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f34a3-2557-498f-a1f8-a912e051c58b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:28.078637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 731/1491] 10.222.0.113 () {54 vars in 931 bytes} [Mon Jul 25 19:13:28 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:28.087411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eeb98-a552-4a67-8acc-b15eada262d1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:28.087879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eeb98-a552-4a67-8acc-b15eada262d1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:28.087988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eeb98-a552-4a67-8acc-b15eada262d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:28.168272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-569eeb98-a552-4a67-8acc-b15eada262d1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:28.170047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-569eeb98-a552-4a67-8acc-b15eada262d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:28.290370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 761/1492] 10.222.0.113 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:28.333229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f34a3-2557-498f-a1f8-a912e051c58b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:28.334814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f2f34a3-2557-498f-a1f8-a912e051c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:28.445938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f34a3-2557-498f-a1f8-a912e051c58b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:28.542339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:28.543250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:28.543598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:28.543983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:28.546654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:28.559008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:28.672998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:28.674405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208e16c-d518-4ab9-9747-2f3693c000bc service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:28.696351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 732/1493] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:38.288545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=82 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:38.691479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=50 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:58.167864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.168500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.168500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.259956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:58.261159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:58.373262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 762/1494] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:14:58.381421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.381912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.382007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.463908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:58.465022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:58.590080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 733/1495] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:14:58.596837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:58.598386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:58.615222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb3c2f-8f55-4ae5-87bd-a02de7c66e17 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:58.699734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:58.748907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:58.750035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.750512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.750976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.752116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:14:58.753258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:58.758528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:58.758528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:14:58.758528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:14:58.758528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:58.767122 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 763/1496] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:14:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:14:58.776282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:58.787490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13887b8a-5ae7-4932-8fda-b8c5da1415cd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:58.862241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:58.901157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:58.901830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.902124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.902379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.903102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:58.904859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:58.904859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:14:58.904859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:14:58.906164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:58.984633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 734/1497] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:14:58 2022] POST /identity/v3/projects => generated 378 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:14:58.985988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:58.987559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:59.034214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39c658-7ad9-4aa7-8181-94b810518f93 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:59.132838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:59.133559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:59.133832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:59.134104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:59.134797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:59.135831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:59.135831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:14:59.135831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:14:59.137036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:59.186296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 764/1498] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:14:58 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:14:59.191104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:59.192679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:59.282746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae17a4-bfcd-4e1d-bbd8-8730f125f277 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:59.371564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:59.385880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:59.386601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:59.386876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:59.387143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:59.387897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:59.388952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:59.388952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:14:59.388952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:14:59.389876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:59.403442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 735/1499] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:14:59 2022] GET /identity/v3/roles => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:14:59.407583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:59.409153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:59.421090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7c46-ce4f-4758-979e-6903466863db admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:59.447671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:59.531620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:59.532303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:59.532585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:59.532864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:59.533629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:59.534661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:59.534661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:14:59.534661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:14:59.535556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbfb2c-3470-4f0f-8877-f4f48e3659aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:59.554889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 765/1500] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:14:59 2022] GET /identity/v3/roles => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:14:59.561672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:59.563534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:59.599453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447f692-3781-4e3b-b8b8-5b5060a0e4d8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:59.700885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:59.701729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:59.702007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:59.702283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] PATH_INFO: `/v3/projects/f9f826798d744115a7f31662def916ba/users/01269f4871b84ee997e29bb3a92ebcef/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:59.726845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f826798d744115a7f31662def916ba, user_id=01269f4871b84ee997e29bb3a92ebcef, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:59.727896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:59.727896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:14:59.727896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:14:59.729923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004c22b-bd0c-40de-86a6-f5c4f78a0628 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:59.762627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 736/1501] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:14:59 2022] PUT /identity/v3/projects/f9f826798d744115a7f31662def916ba/users/01269f4871b84ee997e29bb3a92ebcef/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:14:59.783412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698f49-4733-45d6-af1f-cf07bdb04600 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:59.783875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698f49-4733-45d6-af1f-cf07bdb04600 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:59.784341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698f49-4733-45d6-af1f-cf07bdb04600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:59.873766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-20698f49-4733-45d6-af1f-cf07bdb04600 None None] MFA Rules not processed for user `01269f4871b84ee997e29bb3a92ebcef`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:59.874997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-20698f49-4733-45d6-af1f-cf07bdb04600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:59.983621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 766/1502] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:14:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:15:00.000958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94264-4c92-4a54-8715-94a78034112b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:00.001289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94264-4c92-4a54-8715-94a78034112b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:00.001612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94264-4c92-4a54-8715-94a78034112b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:00.002993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 737/1503] 10.222.0.113 () {54 vars in 969 bytes} [Mon Jul 25 19:14:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:15:00.008922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d3f3c-dcfe-4879-8e4b-43ca81fcc8e5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:00.009235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d3f3c-dcfe-4879-8e4b-43ca81fcc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:00.009509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d3f3c-dcfe-4879-8e4b-43ca81fcc8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:00.044490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:00.098170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a52d3f3c-dcfe-4879-8e4b-43ca81fcc8e5 None None] MFA Rules not processed for user `59220145172c436b8995414a68d94bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:15:00.099532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a52d3f3c-dcfe-4879-8e4b-43ca81fcc8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:00.199846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 767/1504] 10.222.0.113 () {58 vars in 1066 bytes} [Mon Jul 25 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:15:00.208259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94264-4c92-4a54-8715-94a78034112b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:00.209817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-76c94264-4c92-4a54-8715-94a78034112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:00.264492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:00.320688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94264-4c92-4a54-8715-94a78034112b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:00.420856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:00.422049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:00.422049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:00.422049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:00.423730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:00.545859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:00.547457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:00.551029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:00.570720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 738/1505] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:15:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:15:00.619685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7c153-9ab1-43b5-8206-cfc4ac485a67 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:00.619972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7c153-9ab1-43b5-8206-cfc4ac485a67 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:00.620247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7c153-9ab1-43b5-8206-cfc4ac485a67 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:00.621582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 768/1506] 10.222.0.113 () {52 vars in 835 bytes} [Mon Jul 25 19:15:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:15:00.625849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:00.627123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:00.741890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa266c5-20e1-4cb0-8c01-48894054d5b1 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:00.855702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:00.856597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:00.856882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:00.857158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] PATH_INFO: `/v3/users/01269f4871b84ee997e29bb3a92ebcef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:00.870549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01269f4871b84ee997e29bb3a92ebcef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:00.871597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:15:00.871597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:15:00.871597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:15:00.872826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:00.883938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:00.953992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01269f4871b84ee997e29bb3a92ebcef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:00.954419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01269f4871b84ee997e29bb3a92ebcef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:00.954944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01269f4871b84ee997e29bb3a92ebcef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:00.973944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01269f4871b84ee997e29bb3a92ebcef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:00.985655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01269f4871b84ee997e29bb3a92ebcef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:01.003140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 739/1507] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:15:00 2022] DELETE /identity/v3/users/01269f4871b84ee997e29bb3a92ebcef => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:15:01.007670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:01.007957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:01.008230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:01.079976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:15:01.081361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:01.183952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:01.200765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 769/1508] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:15:01.216102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:01.217567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:01.355430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7097c-52b8-4ecf-9864-ebd60edcdfcb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:01.433273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:01.456120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:01.456702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:01.456981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:01.457284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:01.459429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:01.585748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:01.587171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604507c3-e2bc-47fd-8835-850699765a37 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:01.615079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 740/1509] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:15:02.020429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:15:02.021702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:15:02.034355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eaa32-a6f3-4cff-80e4-45f0d9ea2022 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:15:02.181158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:15:02.182420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:15:02.182708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:15:02.182988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] PATH_INFO: `/v3/projects/f9f826798d744115a7f31662def916ba` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:15:02.195822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f826798d744115a7f31662def916ba)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:15:02.196921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:15:02.196921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:15:02.196921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:15:02.198277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:15:02.277238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f826798d744115a7f31662def916ba', 'request_id': 'req-9d223105-d08c-4955-a609-adae8fa46a10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:02.293364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f826798d744115a7f31662def916ba', 'request_id': 'req-9d223105-d08c-4955-a609-adae8fa46a10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:02.303234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f826798d744115a7f31662def916ba', 'request_id': 'req-9d223105-d08c-4955-a609-adae8fa46a10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:02.471235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] The token cache is being invalidate because project f9f826798d744115a7f31662def916ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:15:02.473350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:02.473792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9d223105-d08c-4955-a609-adae8fa46a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:15:02.482770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 770/1510] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:15:02 2022] DELETE /identity/v3/projects/f9f826798d744115a7f31662def916ba => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:15:11.612083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=62 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:12.464513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:00.134248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16978e92-336e-4f8f-a329-13865634761b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:00.134856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16978e92-336e-4f8f-a329-13865634761b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:00.134856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16978e92-336e-4f8f-a329-13865634761b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:00.136448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:17:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:00.143689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473c46-2184-4239-9873-318ba3dedc2c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:00.144286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473c46-2184-4239-9873-318ba3dedc2c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:00.144399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473c46-2184-4239-9873-318ba3dedc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:00.237743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-23473c46-2184-4239-9873-318ba3dedc2c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:00.239077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-23473c46-2184-4239-9873-318ba3dedc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:00.357366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:00.512241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16978e92-336e-4f8f-a329-13865634761b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:00.514842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-16978e92-336e-4f8f-a329-13865634761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:00.646082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16978e92-336e-4f8f-a329-13865634761b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:00.652698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d669b8e-0777-42e4-800d-1d22d999d238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:00.653387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d669b8e-0777-42e4-800d-1d22d999d238 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:00.653656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d669b8e-0777-42e4-800d-1d22d999d238 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:00.653925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d669b8e-0777-42e4-800d-1d22d999d238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:00.663164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d669b8e-0777-42e4-800d-1d22d999d238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:00.664771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d669b8e-0777-42e4-800d-1d22d999d238 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:00.675378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 742/1513] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:01.563053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf32c33-f4d3-4ceb-9dae-bc2e8d0dfdb7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:01.563861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf32c33-f4d3-4ceb-9dae-bc2e8d0dfdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:01.563861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf32c33-f4d3-4ceb-9dae-bc2e8d0dfdb7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:01.564981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:17:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:01.572037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f274ad-0d81-4964-8a95-e44e7015a34a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:01.572644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f274ad-0d81-4964-8a95-e44e7015a34a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:01.572644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f274ad-0d81-4964-8a95-e44e7015a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:01.605084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c9f274ad-0d81-4964-8a95-e44e7015a34a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:01.607747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c9f274ad-0d81-4964-8a95-e44e7015a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:01.616636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:01.779462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf32c33-f4d3-4ceb-9dae-bc2e8d0dfdb7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:01.795546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf32c33-f4d3-4ceb-9dae-bc2e8d0dfdb7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:01.801668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d4221-bd53-4711-aa75-ca98b8759779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:01.802725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4221-bd53-4711-aa75-ca98b8759779 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:01.803022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4221-bd53-4711-aa75-ca98b8759779 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:01.803425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4221-bd53-4711-aa75-ca98b8759779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:01.814825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d4221-bd53-4711-aa75-ca98b8759779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:01.816692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d4221-bd53-4711-aa75-ca98b8759779 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:01.829141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 773/1516] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:03.674384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5ca3-9675-4cab-a20e-d0761ef24d83 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:03.674955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5ca3-9675-4cab-a20e-d0761ef24d83 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:03.674955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b5ca3-9675-4cab-a20e-d0761ef24d83 None None] PATH_INFO: `/v3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:03.676180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 744/1517] 10.222.0.59 () {54 vars in 929 bytes} [Mon Jul 25 19:17:03 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:17:03.683790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0062de-b3cc-4c59-a96f-86a33664c07e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:03.684331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0062de-b3cc-4c59-a96f-86a33664c07e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:03.684331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0062de-b3cc-4c59-a96f-86a33664c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:03.769372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fc0062de-b3cc-4c59-a96f-86a33664c07e None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:03.771382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fc0062de-b3cc-4c59-a96f-86a33664c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:03.795447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:03.878962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 774/1518] 10.222.0.59 () {58 vars in 1019 bytes} [Mon Jul 25 19:17:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:08.174123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683a1c-aa62-44f5-a8db-8396c2d5e93e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:08.174645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683a1c-aa62-44f5-a8db-8396c2d5e93e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:08.174645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683a1c-aa62-44f5-a8db-8396c2d5e93e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:08.175982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 745/1519] 10.222.0.113 () {54 vars in 966 bytes} [Mon Jul 25 19:17:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:08.181426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eebc1-6498-4b2b-aaec-8278a3e8fe0f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:08.181892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eebc1-6498-4b2b-aaec-8278a3e8fe0f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:08.182223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eebc1-6498-4b2b-aaec-8278a3e8fe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:08.204251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5d8eebc1-6498-4b2b-aaec-8278a3e8fe0f None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:08.205531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5d8eebc1-6498-4b2b-aaec-8278a3e8fe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:08.215892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 775/1520] 10.222.0.113 () {58 vars in 1063 bytes} [Mon Jul 25 19:17:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:08.223684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683a1c-aa62-44f5-a8db-8396c2d5e93e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:08.239241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683a1c-aa62-44f5-a8db-8396c2d5e93e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:08.245986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7573a-271e-43fe-8ad1-a1dd6d91f958 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:08.246649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7573a-271e-43fe-8ad1-a1dd6d91f958 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:08.246939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7573a-271e-43fe-8ad1-a1dd6d91f958 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:08.247222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7573a-271e-43fe-8ad1-a1dd6d91f958 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:08.256995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7573a-271e-43fe-8ad1-a1dd6d91f958 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:08.258641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7573a-271e-43fe-8ad1-a1dd6d91f958 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:08.269018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 746/1521] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:13.278771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b902a-edcf-4e49-860a-19443a24af00 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:13.279593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b902a-edcf-4e49-860a-19443a24af00 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:13.279593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b902a-edcf-4e49-860a-19443a24af00 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:13.280856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:17:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:13.286261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761a8f9-a4cf-43f2-9f2d-6a6b01fe5ed2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:13.286977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761a8f9-a4cf-43f2-9f2d-6a6b01fe5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:13.287267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761a8f9-a4cf-43f2-9f2d-6a6b01fe5ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:13.309447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4761a8f9-a4cf-43f2-9f2d-6a6b01fe5ed2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:13.310694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4761a8f9-a4cf-43f2-9f2d-6a6b01fe5ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:13.319167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:13.474062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b902a-edcf-4e49-860a-19443a24af00 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:13.490207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b902a-edcf-4e49-860a-19443a24af00 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:13.496177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06388f9-65b5-4bc4-886d-cf53deee650c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:13.496844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06388f9-65b5-4bc4-886d-cf53deee650c service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:13.497136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06388f9-65b5-4bc4-886d-cf53deee650c service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:13.497428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06388f9-65b5-4bc4-886d-cf53deee650c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:13.506347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06388f9-65b5-4bc4-886d-cf53deee650c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:13.507954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06388f9-65b5-4bc4-886d-cf53deee650c service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:13.518326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 777/1524] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:17:14.380227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2665f3-a4d0-437a-b149-06c78f0bbce8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:14.380734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2665f3-a4d0-437a-b149-06c78f0bbce8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:14.380817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2665f3-a4d0-437a-b149-06c78f0bbce8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:14.383225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:17:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:14.391197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a473-880b-4bc1-a129-e464e935448f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:14.391963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a473-880b-4bc1-a129-e464e935448f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:14.391963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a473-880b-4bc1-a129-e464e935448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:14.416128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f531a473-880b-4bc1-a129-e464e935448f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:14.417423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f531a473-880b-4bc1-a129-e464e935448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:14.426327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:14.583830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2665f3-a4d0-437a-b149-06c78f0bbce8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:14.602145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2665f3-a4d0-437a-b149-06c78f0bbce8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:14.608352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526a72-c833-4d73-86d8-e16aabc27d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:14.609023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526a72-c833-4d73-86d8-e16aabc27d12 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:14.609335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526a72-c833-4d73-86d8-e16aabc27d12 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:14.609615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526a72-c833-4d73-86d8-e16aabc27d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:14.620543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526a72-c833-4d73-86d8-e16aabc27d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:14.622233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526a72-c833-4d73-86d8-e16aabc27d12 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:14.632914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 749/1527] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:18.837194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f0f8-a3a9-4fc1-9f74-e7b9420d71c6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:18.837765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f0f8-a3a9-4fc1-9f74-e7b9420d71c6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:18.837991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f0f8-a3a9-4fc1-9f74-e7b9420d71c6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:18.839364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:18.845418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb3cc-c91c-4c6f-ba6a-9fac1da449d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:18.846081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb3cc-c91c-4c6f-ba6a-9fac1da449d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:18.846081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb3cc-c91c-4c6f-ba6a-9fac1da449d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:18.867912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4f2eb3cc-c91c-4c6f-ba6a-9fac1da449d5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:18.869243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4f2eb3cc-c91c-4c6f-ba6a-9fac1da449d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:18.879034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:18.958941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5f0f8-a3a9-4fc1-9f74-e7b9420d71c6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:18.960787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-84e5f0f8-a3a9-4fc1-9f74-e7b9420d71c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:19.064838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5f0f8-a3a9-4fc1-9f74-e7b9420d71c6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:19.068712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fba4a-e0ea-4886-92a5-e43c6221da5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:19.069405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fba4a-e0ea-4886-92a5-e43c6221da5b service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:19.069651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fba4a-e0ea-4886-92a5-e43c6221da5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:19.069921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fba4a-e0ea-4886-92a5-e43c6221da5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:19.081638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fba4a-e0ea-4886-92a5-e43c6221da5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:19.083107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fba4a-e0ea-4886-92a5-e43c6221da5b service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:19.097575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 780/1530] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:21.167267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354d62c-537d-4b15-a10a-6f278899eab9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:21.167957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354d62c-537d-4b15-a10a-6f278899eab9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:21.167957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354d62c-537d-4b15-a10a-6f278899eab9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:21.169238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:21.174579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663ad65-aec0-4d5f-a3e6-958c38ed16df None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:21.175062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663ad65-aec0-4d5f-a3e6-958c38ed16df None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:21.175163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663ad65-aec0-4d5f-a3e6-958c38ed16df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:21.195793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7663ad65-aec0-4d5f-a3e6-958c38ed16df None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:21.197563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7663ad65-aec0-4d5f-a3e6-958c38ed16df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:21.206157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:21.243300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354d62c-537d-4b15-a10a-6f278899eab9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:21.256741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354d62c-537d-4b15-a10a-6f278899eab9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:21.262033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87cfa-e0b1-4780-b64d-91a0803799df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:21.262692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87cfa-e0b1-4780-b64d-91a0803799df service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:21.262972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87cfa-e0b1-4780-b64d-91a0803799df service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:21.263247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87cfa-e0b1-4780-b64d-91a0803799df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:21.273185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87cfa-e0b1-4780-b64d-91a0803799df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:21.274628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87cfa-e0b1-4780-b64d-91a0803799df service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:21.284988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 752/1533] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:25.203334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ae8a-24ca-450a-b96d-559ebf131981 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:25.203949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ae8a-24ca-450a-b96d-559ebf131981 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:25.203949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ae8a-24ca-450a-b96d-559ebf131981 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:25.205377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:25.210712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e290-8ea5-40c4-b3bb-c80a21d8de27 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:25.211162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e290-8ea5-40c4-b3bb-c80a21d8de27 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:25.211276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e290-8ea5-40c4-b3bb-c80a21d8de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:25.220790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:25.234594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-70f1e290-8ea5-40c4-b3bb-c80a21d8de27 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:25.236577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-70f1e290-8ea5-40c4-b3bb-c80a21d8de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:25.248078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:25.553588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ae8a-24ca-450a-b96d-559ebf131981 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:25.556202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3850ae8a-24ca-450a-b96d-559ebf131981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:25.635720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:25.651458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ae8a-24ca-450a-b96d-559ebf131981 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:25.655412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b988-9033-42b3-9f5b-66cda5d9ea4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:25.656110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b988-9033-42b3-9f5b-66cda5d9ea4a service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:25.656387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b988-9033-42b3-9f5b-66cda5d9ea4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:25.656659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b988-9033-42b3-9f5b-66cda5d9ea4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:25.667372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626b988-9033-42b3-9f5b-66cda5d9ea4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:25.668842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626b988-9033-42b3-9f5b-66cda5d9ea4a service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:25.679458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 783/1536] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:27.752838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d94a3-9f40-476b-a9cf-5cf61455453f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:27.753426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d94a3-9f40-476b-a9cf-5cf61455453f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:27.753426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d94a3-9f40-476b-a9cf-5cf61455453f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:27.754715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:17:27.760894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28912e-eb69-4cbb-9c58-1f529c2b9423 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:27.761457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28912e-eb69-4cbb-9c58-1f529c2b9423 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:27.761457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28912e-eb69-4cbb-9c58-1f529c2b9423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:27.781979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fe28912e-eb69-4cbb-9c58-1f529c2b9423 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:27.783085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fe28912e-eb69-4cbb-9c58-1f529c2b9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:27.791492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:28.102752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d94a3-9f40-476b-a9cf-5cf61455453f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:28.104879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bf8d94a3-9f40-476b-a9cf-5cf61455453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:28.119552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d94a3-9f40-476b-a9cf-5cf61455453f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:28.123414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd1920-7919-40f9-ad60-b4718cf74037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:28.124109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd1920-7919-40f9-ad60-b4718cf74037 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:28.124394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd1920-7919-40f9-ad60-b4718cf74037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:28.124673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd1920-7919-40f9-ad60-b4718cf74037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:28.135316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd1920-7919-40f9-ad60-b4718cf74037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:28.136798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd1920-7919-40f9-ad60-b4718cf74037 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:28.147464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 755/1539] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:37.776688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=11 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:38.142555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=8 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:08.769792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d662a-0565-4454-b7f0-87daa0a7f1e8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.771370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d662a-0565-4454-b7f0-87daa0a7f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.771912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d662a-0565-4454-b7f0-87daa0a7f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.800688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-046d662a-0565-4454-b7f0-87daa0a7f1e8 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:08.802632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-046d662a-0565-4454-b7f0-87daa0a7f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:08.812285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ce930-343b-4cfb-b866-1d9c2a79baa2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.813392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ce930-343b-4cfb-b866-1d9c2a79baa2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.813896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ce930-343b-4cfb-b866-1d9c2a79baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.815605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 785/1540] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:08.824668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.825019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.825252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.850660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a08ce930-343b-4cfb-b866-1d9c2a79baa2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:08.852367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a08ce930-343b-4cfb-b866-1d9c2a79baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:08.860359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:08.862035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:08.869698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 756/1541] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:08.878560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.879094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 786/1542] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:08.879391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.879712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.881133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:08.896270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112bf32-22da-4045-8a4e-e2ff4e578554 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:08.904295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:08.905413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.905924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.906454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.907411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:08.908048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:08.910573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4314-d13e-4a0a-b8d9-1ed836b6de9a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:08.929588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:08.931170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:08.956091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 787/1543] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:19:08.957762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 757/1544] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:08.958393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.958856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.959342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.965040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:08.979223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ca9d-4142-4ceb-8eaa-38ae066de641 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:08.995506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f5c41-c28f-482d-885a-4877961887b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:08.996471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f5c41-c28f-482d-885a-4877961887b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:08.996972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f5c41-c28f-482d-885a-4877961887b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:08.997465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f5c41-c28f-482d-885a-4877961887b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:08.998407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f5c41-c28f-482d-885a-4877961887b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.000703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f5c41-c28f-482d-885a-4877961887b8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.010349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.011822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.029262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 788/1545] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.030003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.052334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72db7d1-2aed-4f32-9b7e-1cbf5ec1e494 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.066675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.067371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.068239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.068523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.069295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.069603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.070660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 758/1546] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:08 2022] POST /identity/v3/projects => generated 358 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.071856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.072630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cfeb-e725-418f-9d12-7c7c530f7a0b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.073087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cfeb-e725-418f-9d12-7c7c530f7a0b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.073563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cfeb-e725-418f-9d12-7c7c530f7a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.101797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 789/1547] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.102310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.129345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4702cfeb-e725-418f-9d12-7c7c530f7a0b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.130947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4702cfeb-e725-418f-9d12-7c7c530f7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.136234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febd9cf-4f53-4d0e-ab7d-33ed66b1c764 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.223784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.224656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.225013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.225327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.226032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.227976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.235341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 759/1548] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.236685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb80ed-b4db-41a0-afb5-daf4187327e9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.236973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb80ed-b4db-41a0-afb5-daf4187327e9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.237307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb80ed-b4db-41a0-afb5-daf4187327e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.261414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 790/1549] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/users => generated 280 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.263688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.265246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a4eb80ed-b4db-41a0-afb5-daf4187327e9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.266675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a4eb80ed-b4db-41a0-afb5-daf4187327e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.275789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a882133-d510-4f6b-a57f-2289dcb46653 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.276036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 760/1550] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.277422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62753f5d-3ff6-4c47-82cc-a81aed3a7a49 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.277710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62753f5d-3ff6-4c47-82cc-a81aed3a7a49 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.277987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62753f5d-3ff6-4c47-82cc-a81aed3a7a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.280935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.281641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.281930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.282359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.283492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.284552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:19:09.284552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:19:09.284552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:19:09.285806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.300802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-62753f5d-3ff6-4c47-82cc-a81aed3a7a49 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.302225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-62753f5d-3ff6-4c47-82cc-a81aed3a7a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.312498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 761/1551] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.314338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.314666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.314945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.328623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 791/1552] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/projects => generated 366 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.330089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.340296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.340296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.409490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296cd9e-1553-4842-86e4-5891d0994249 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.414674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.415338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.415654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.415929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.416662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.416941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.418623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f530d1c-7f4d-4c0e-8e0e-0177e7c923ea admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.421815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 762/1553] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.423095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.444761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 792/1554] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.445000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7742db-eb2e-4242-9df9-cf6dea48a0fe None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.445092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4901e-4205-47ab-a0ec-a77d3bb86b24 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.445092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4901e-4205-47ab-a0ec-a77d3bb86b24 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.445092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4901e-4205-47ab-a0ec-a77d3bb86b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.445373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d46b-d084-4737-8ea4-039453572690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.445373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d46b-d084-4737-8ea4-039453572690 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.445373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d46b-d084-4737-8ea4-039453572690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.445373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d46b-d084-4737-8ea4-039453572690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.445670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33d46b-d084-4737-8ea4-039453572690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.445670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33d46b-d084-4737-8ea4-039453572690 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.460176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 763/1555] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:09.461427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafe3b-dac6-45b7-8303-93e7de074e56 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.461830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafe3b-dac6-45b7-8303-93e7de074e56 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.462478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafe3b-dac6-45b7-8303-93e7de074e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.470168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-06a4901e-4205-47ab-a0ec-a77d3bb86b24 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.471345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-06a4901e-4205-47ab-a0ec-a77d3bb86b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.479824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 793/1556] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.482044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.482326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.482601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.484882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-28fafe3b-dac6-45b7-8303-93e7de074e56 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.486959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-28fafe3b-dac6-45b7-8303-93e7de074e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.497808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 764/1557] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.499788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263dada-5720-4e20-a5fb-aac3a5980d32 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.500286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263dada-5720-4e20-a5fb-aac3a5980d32 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.500761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263dada-5720-4e20-a5fb-aac3a5980d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.503573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.504808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.513600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 794/1558] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.515527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.524840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:09.527538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1263dada-5720-4e20-a5fb-aac3a5980d32 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.528800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1263dada-5720-4e20-a5fb-aac3a5980d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.535317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6257db9-7230-4cfb-a9c6-c5759156c67f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.537876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 765/1559] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.539583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.539841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.540111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.545063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.545802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.546095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.546380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.547129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.549216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.565550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.566833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.574656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 795/1560] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/users => generated 284 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.575519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.576286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 766/1561] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.577142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.591849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08355-028a-4a5b-b28e-70a7f9d3b688 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.592237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0050c-074e-4890-9ee6-8cdd496d33d7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.597356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.598067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.598533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.598927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.599615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.600679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7576d2-0a13-481a-8daa-ba0904e6a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.601391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7576d2-0a13-481a-8daa-ba0904e6a996 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.601593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.601704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7576d2-0a13-481a-8daa-ba0904e6a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.601999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7576d2-0a13-481a-8daa-ba0904e6a996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.603058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7576d2-0a13-481a-8daa-ba0904e6a996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.604933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7576d2-0a13-481a-8daa-ba0904e6a996 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.619662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 767/1562] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:09.620041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7b2b-9e88-4816-baf1-5f12a99aa976 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.620160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7b2b-9e88-4816-baf1-5f12a99aa976 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.620425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7b2b-9e88-4816-baf1-5f12a99aa976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.629377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:09.634261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 796/1563] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/projects => generated 378 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.635173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.645426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1f6d7b2b-9e88-4816-baf1-5f12a99aa976 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.646918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1f6d7b2b-9e88-4816-baf1-5f12a99aa976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.714114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 768/1564] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.714440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c932a-58ea-4f28-9a06-852cea25309d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.715607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.715959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.716189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.719409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.720096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.720379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.720684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.721423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.721718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.723342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.736712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 797/1565] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.737780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.742142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:09.743708 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:09.749028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da981264-c5bb-49dd-af8d-ec475988e1b3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.753346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 769/1566] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:09.754261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.754419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.755096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.755457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.755937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.756955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.757309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.761153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.767535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922443b3-2d25-4b24-8b12-001f0d2832bb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.772947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 798/1567] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.773496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.773835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.773956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.774261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.774538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.775297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.777011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.787529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79667-8cd6-4b68-afba-eb9895141563 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.790023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 770/1568] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:09.790879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.792778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.793864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.794154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.794430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.795163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.795499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.797154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.801705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdad4c-bef4-46b9-97d5-4d55af458904 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.807774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.808690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.808971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.809277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] PATH_INFO: `/v3/projects/5d0d2cec89574402adff587f5310c089/users/47d13ebf2e9643f69077104e88347edc/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.810189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 799/1569] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.811198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.821922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0931b-5ab5-4900-a73a-803e4e43668c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.826676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.827367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.827686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.827939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.828633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.830658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.833190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0d2cec89574402adff587f5310c089, user_id=47d13ebf2e9643f69077104e88347edc, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.837032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.856361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 771/1570] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:09 2022] PUT /identity/v3/projects/5d0d2cec89574402adff587f5310c089/users/47d13ebf2e9643f69077104e88347edc/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:09.857531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 800/1571] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.857692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.861673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.873142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb6a7b-fb4a-4648-ab48-828b807876a9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.935013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d894fb8-937d-4177-88bb-e4e4e42d8891 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.939826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.940553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.940780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.941064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.941814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.942117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.942403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.943227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:19:09.943227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:19:09.943227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:19:09.943620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.943722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.944026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.944224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.944743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.947016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.956469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 772/1572] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.957686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.969907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228734f-88b4-4038-9554-bfcbcfc7b506 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:09.970723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:09.975463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:09.976148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:09.976451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:09.976731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:09.977510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:09.977815 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:09.979647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:09.980863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 801/1573] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/projects => generated 386 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:09.982223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:09.994118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 773/1574] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:09.995060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.006366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b981-8e93-4d05-a69b-49fa6ceddc9c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.049006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:10.069388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.069655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982be83-16e2-4d1f-9231-f67ee6f35abf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.070126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.070411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.070732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.071510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.073505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.075540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.076326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.076670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.076948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.077782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.079824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.085322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 774/1575] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:10.086155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.098787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e647ba-d2f9-4386-8971-e33b544ea4c6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.113072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b1ba-22ea-437b-917d-79939abe8202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.113800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b1ba-22ea-437b-917d-79939abe8202 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.114061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b1ba-22ea-437b-917d-79939abe8202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.114599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b1ba-22ea-437b-917d-79939abe8202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.115553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263b1ba-22ea-437b-917d-79939abe8202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.117523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263b1ba-22ea-437b-917d-79939abe8202 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.123717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 802/1576] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:09 2022] POST /identity/v3/projects => generated 378 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.124565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.155442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 775/1577] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/projects => generated 406 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.159913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.159913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.159913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.199183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] MFA Rules not processed for user `47d13ebf2e9643f69077104e88347edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:10.200694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:10.217648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6888-311c-4d5a-a6d6-33239e1de363 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.289353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 776/1578] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:10.289353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.301691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.303166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.303650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.304144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.305558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.308619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.326946 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 803/1579] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:10.327817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.341324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef86e-6a11-4ae8-b8e3-de6c58b7c142 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.346298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.347013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.347294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.347568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.348295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.350983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.358577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba3a33-2e46-4b8e-b564-f6108202df58 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.363639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.364434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.364830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.365201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.365968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.368071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.378883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 804/1580] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/users => generated 294 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.381041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.397264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd96b26-7fd0-4b89-afae-53fe6b1c8759 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.403374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.404058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.404346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.404688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.405369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.407258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 777/1581] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/projects => generated 404 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.407564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.408633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.414099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:10.441687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 805/1582] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/projects => generated 386 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.442759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.452031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:10.487762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78602-8a04-40cc-a447-29fc4adb61d1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.520093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0568af-b073-467e-96d0-f5054795cf81 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.526887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.527624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.528090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.528380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.529821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.531837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.556993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 806/1583] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.557403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.558295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.558448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.558632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.558868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] PATH_INFO: `/v3/projects/6c9f6e769984407a8f84b3ea1f4584b5/users/a35d74ff357b45fc86db211bb0034541/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.571823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff0092-9038-40e6-b4b0-ee7197c6ae0d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.576699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.577098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9f6e769984407a8f84b3ea1f4584b5, user_id=a35d74ff357b45fc86db211bb0034541, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.577457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.577743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.578020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.578734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.579833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.580701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.599949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 778/1584] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:10 2022] PUT /identity/v3/projects/6c9f6e769984407a8f84b3ea1f4584b5/users/a35d74ff357b45fc86db211bb0034541/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:10.601106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.614234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 807/1585] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/users => generated 304 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.614234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.628563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864100c1-9246-40a7-975e-9a2985a0d7aa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.684774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1764-41e5-498f-a117-6c41a449affb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.692022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.693237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.694182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.694765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.696104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.697940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.698616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.698898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.699163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.699883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.700008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.701510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.715411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 808/1586] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:10.716797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.731379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2ed6f-6c6d-4df5-b282-f5c6cd7a8db1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.739259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 779/1587] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/projects => generated 356 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.739259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.740714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.741443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.741725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.741995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.742707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.744356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.756477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 809/1588] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:10.757381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.769739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca130d-e03e-4bb9-adf7-7a93b1e2c604 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.793721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:10.810868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58634ad-0196-4b05-b310-82b591dfdfec admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.815321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:10.815878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.816310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.816592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.816869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.817939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.819159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:19:10.819159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:19:10.819159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:19:10.820485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.834473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.835143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.835427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.835703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.836490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.838773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.844349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 780/1589] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.845443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.857408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ae878-6fdd-4e46-a376-f78ff245a8c3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.862485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dbd0f-55bb-4fda-bbbd-793b4f3b0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.863178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dbd0f-55bb-4fda-bbbd-793b4f3b0430 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.863459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dbd0f-55bb-4fda-bbbd-793b4f3b0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.863626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 810/1590] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:10.864567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.865360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dbd0f-55bb-4fda-bbbd-793b4f3b0430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.866600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dbd0f-55bb-4fda-bbbd-793b4f3b0430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.868335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dbd0f-55bb-4fda-bbbd-793b4f3b0430 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.878233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4e5e1-a214-47c8-9dc1-18f7e9a790a6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.879584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 781/1591] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:10.881138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.881432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.881715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.884041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.884811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.885317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.885553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.886347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.888057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.901382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 811/1592] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:10.902314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.912574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] MFA Rules not processed for user `a35d74ff357b45fc86db211bb0034541`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:10.913354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732b80d-935a-4b23-bb52-0121a4b6d4d5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:10.913831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:10.918261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:10.919169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:10.919530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:10.919825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] PATH_INFO: `/v3/projects/78d0c377e85147c5b8e700039a88ba0c/users/113a0a0591384937ae2408f468be8e79/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:10.936368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d0c377e85147c5b8e700039a88ba0c, user_id=113a0a0591384937ae2408f468be8e79, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:10.937627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:19:10.937627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:19:10.937627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:19:10.939823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:10.963082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 812/1593] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:10 2022] PUT /identity/v3/projects/78d0c377e85147c5b8e700039a88ba0c/users/113a0a0591384937ae2408f468be8e79/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:10.964768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.984966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 782/1594] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:10.985879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:10.997852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196ce32-4372-4ca8-a763-4d604986077a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.044488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951be1-2a2b-4c97-b432-2d14f9bbb462 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.049965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.050645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.050925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.051197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.051925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.054253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.058510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.059191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.059476 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.059753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.060489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.062313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.073828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 783/1595] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.074701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.083649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 813/1596] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:10 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:11.083649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.086197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16864b-9f78-48e2-a20c-7645aaba614f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.099215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.099890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.100027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d0b4-0e8e-4973-ba47-f40b1f97428b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.100141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.100487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.101292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.102948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.106366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.107078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.107365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.107686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.108552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.110896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.114593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 784/1597] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.115617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.127638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad81f1-86a9-4960-a1d7-8137e50a9da1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.127992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 814/1598] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.128851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.133479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f0608-4d7a-49e8-9829-b1e56300d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.134185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0608-4d7a-49e8-9829-b1e56300d141 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.134900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0608-4d7a-49e8-9829-b1e56300d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.135176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0608-4d7a-49e8-9829-b1e56300d141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.135922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0608-4d7a-49e8-9829-b1e56300d141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.138242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0608-4d7a-49e8-9829-b1e56300d141 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.140478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f90d8-4122-4e24-9485-88720866c856 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.146481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.147437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.147718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.147992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.148713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.157470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.157679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 785/1599] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.157679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.157679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.157679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.165803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 815/1600] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.165803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.174959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:11.176338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:11.184327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 786/1601] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:11.185191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.196263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a90c25-4516-44ce-b59c-e753b5135079 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.205551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.206472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.206755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.207039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] PATH_INFO: `/v3/projects/cf0dd2da9f9c47b3a2d28a64950935aa/users/f99afdfcdd32429f88a03a06dd71453e/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.225992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0dd2da9f9c47b3a2d28a64950935aa, user_id=f99afdfcdd32429f88a03a06dd71453e, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.231002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.243620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:11.247426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d93a-13f7-4276-9295-9c3a0c568748 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.256088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 787/1602] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:11 2022] PUT /identity/v3/projects/cf0dd2da9f9c47b3a2d28a64950935aa/users/f99afdfcdd32429f88a03a06dd71453e/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:11.256088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.268951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:11.309451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.310255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.310496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.310769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.330033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ee9c-b7c0-4624-ad25-3a0317bdb59d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.335816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.336571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.336908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.337527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.338412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.340073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.351209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 788/1603] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.352161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.362234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db8849-e05c-4b95-93f8-1dc87ae1ad08 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.367132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.368167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.368423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.368702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.369531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.371152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.382604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 789/1604] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.382769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.389418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.390899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.393562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c310e1-306b-4dcb-9042-df8179e2f46b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.398885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.399575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.399866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.400140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.400886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.402534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.405071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 816/1605] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:11.406270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.417993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 790/1606] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:11.418596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.421790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99bcda-43c4-4ad0-b7a7-60dd684257aa service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.427761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.428905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.429439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.429747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] PATH_INFO: `/v3/projects/cf96adf639284e72aa9c8bec44aa199f/users/ae9d01db3b9c488a9e16da9f8663281e/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.432127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d26-1bbe-4e6c-908b-119f85fa7bf9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.437568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30740cf7-f969-4d7f-a49f-a1498472c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.438507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740cf7-f969-4d7f-a49f-a1498472c513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.438792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740cf7-f969-4d7f-a49f-a1498472c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.439038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740cf7-f969-4d7f-a49f-a1498472c513 admin admin] PATH_INFO: `/v3/projects/faa1a7554548484e873349e1bc29fb1d/users/87da6642d2d343a384663ea655c47fec/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.449871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf96adf639284e72aa9c8bec44aa199f, user_id=ae9d01db3b9c488a9e16da9f8663281e, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.452642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.456488 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30740cf7-f969-4d7f-a49f-a1498472c513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa1a7554548484e873349e1bc29fb1d, user_id=87da6642d2d343a384663ea655c47fec, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.459678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30740cf7-f969-4d7f-a49f-a1498472c513 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.472408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 817/1607] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:11 2022] PUT /identity/v3/projects/cf96adf639284e72aa9c8bec44aa199f/users/ae9d01db3b9c488a9e16da9f8663281e/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:11.474301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.477082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:11.482736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 791/1608] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:11 2022] PUT /identity/v3/projects/faa1a7554548484e873349e1bc29fb1d/users/87da6642d2d343a384663ea655c47fec/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:11.484056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.484348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.484626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.509777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:11.511463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:11.554211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ce724-699c-45c7-9240-c835fba2ba4f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.593814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 792/1609] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:11.595382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.608264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceedf62-e9e4-4417-a4a3-80e661bc7dc7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.614158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.615123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.615402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.615682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] PATH_INFO: `/v3/projects/9f4f42e87c8a4ae283ceb8b6ee2b3268/users/26f33d48b0ec4aa2a104110e79bb9f87/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.633800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.634501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.634786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.635214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.636926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4f42e87c8a4ae283ceb8b6ee2b3268, user_id=26f33d48b0ec4aa2a104110e79bb9f87, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.639810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.647489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.648959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.659407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 818/1610] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:11.660224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.672007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f22ff-6f07-4e52-8d0a-f425a50a0606 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.676598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef199b9-3d1b-4299-8354-43b7d3b79d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.677895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef199b9-3d1b-4299-8354-43b7d3b79d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.678279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef199b9-3d1b-4299-8354-43b7d3b79d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.678699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef199b9-3d1b-4299-8354-43b7d3b79d07 admin admin] PATH_INFO: `/v3/projects/d8627c72f1d74672ba936aca3b40cfac/users/4806a18af90f4292a9b1a801d4b21696/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.688975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:11.699287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef199b9-3d1b-4299-8354-43b7d3b79d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8627c72f1d74672ba936aca3b40cfac, user_id=4806a18af90f4292a9b1a801d4b21696, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.703532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef199b9-3d1b-4299-8354-43b7d3b79d07 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:11.704262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 793/1611] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:11 2022] PUT /identity/v3/projects/9f4f42e87c8a4ae283ceb8b6ee2b3268/users/26f33d48b0ec4aa2a104110e79bb9f87/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:11.705111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.737259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 819/1612] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:11 2022] PUT /identity/v3/projects/d8627c72f1d74672ba936aca3b40cfac/users/4806a18af90f4292a9b1a801d4b21696/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:11.738970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467750-ac2f-40f8-b6ce-0edc946c5730 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.739606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467750-ac2f-40f8-b6ce-0edc946c5730 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.740748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467750-ac2f-40f8-b6ce-0edc946c5730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.744251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:11.777837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-53467750-ac2f-40f8-b6ce-0edc946c5730 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:11.779825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-53467750-ac2f-40f8-b6ce-0edc946c5730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:11.810221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8c77d-ebf1-4d21-a6a7-76d8feb9f487 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:11.870898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 820/1613] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:11.872208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.872704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.873048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.914085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:11.917398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:11.925691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:11.927539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:11.928099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:11.928980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] PATH_INFO: `/v3/projects/f7491e24c4fb4fb09238a2e66fd7686e/users/0d89d5eb7ba647a6bd761ce8cdfa2469/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:11.937643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 821/1614] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:11.938953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:11.957351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7491e24c4fb4fb09238a2e66fd7686e, user_id=0d89d5eb7ba647a6bd761ce8cdfa2469, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:11.961471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.000665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 794/1615] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:11 2022] PUT /identity/v3/projects/f7491e24c4fb4fb09238a2e66fd7686e/users/0d89d5eb7ba647a6bd761ce8cdfa2469/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:12.003724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.027235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf8c03-c2bf-4ef6-b01a-355f568df759 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.105360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16fb62-b913-4062-a137-8d284c5372c8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.112387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec578a0-706d-4f22-a6fa-543c9e48de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.113702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec578a0-706d-4f22-a6fa-543c9e48de40 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.114248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec578a0-706d-4f22-a6fa-543c9e48de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.114794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec578a0-706d-4f22-a6fa-543c9e48de40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.116033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec578a0-706d-4f22-a6fa-543c9e48de40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.118000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec578a0-706d-4f22-a6fa-543c9e48de40 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.141519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 795/1616] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:12 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:12.146694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612b74-6f0c-4da0-8b2f-bf116ac0d27f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.146694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612b74-6f0c-4da0-8b2f-bf116ac0d27f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.146694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb612b74-6f0c-4da0-8b2f-bf116ac0d27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.168828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.169488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.169864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.170235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.191741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fb612b74-6f0c-4da0-8b2f-bf116ac0d27f None None] MFA Rules not processed for user `4806a18af90f4292a9b1a801d4b21696`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:12.191741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb612b74-6f0c-4da0-8b2f-bf116ac0d27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:12.192158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.192158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.200670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 822/1617] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:12.201856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.212728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7e7f-4b5b-4644-8f08-bc4244823e85 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.219252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.220497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.221197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.221772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.239009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.240702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.242740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:12.266250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 823/1618] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:12.267848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.281247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fb80-299b-44dd-9e88-bde1f205d88e service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.288477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.289390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.289971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.290530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.306638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 796/1619] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:12.308543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12110f04-0158-45b8-85d8-5e7a36a85c69 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.308863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12110f04-0158-45b8-85d8-5e7a36a85c69 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.309222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12110f04-0158-45b8-85d8-5e7a36a85c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.340547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.343385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.376884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 824/1620] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:12.376884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.381996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-12110f04-0158-45b8-85d8-5e7a36a85c69 None None] MFA Rules not processed for user `0d89d5eb7ba647a6bd761ce8cdfa2469`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:12.383434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-12110f04-0158-45b8-85d8-5e7a36a85c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:12.416578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667bae-dd82-4773-8f03-6d961fa2498e service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.431298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.434671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.435001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.435290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] PATH_INFO: `/v3/projects/9f4f42e87c8a4ae283ceb8b6ee2b3268/users/26f33d48b0ec4aa2a104110e79bb9f87/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.443544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4f42e87c8a4ae283ceb8b6ee2b3268, user_id=26f33d48b0ec4aa2a104110e79bb9f87, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.457318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.487769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:12.513652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 825/1621] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:12 2022] PUT /identity/v3/projects/9f4f42e87c8a4ae283ceb8b6ee2b3268/users/26f33d48b0ec4aa2a104110e79bb9f87/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:12.514699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.555375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 797/1622] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:12.557085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac7cc-e918-442c-adf1-1c80cb3ba886 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.557439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac7cc-e918-442c-adf1-1c80cb3ba886 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.557726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aac7cc-e918-442c-adf1-1c80cb3ba886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.606102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d9aac7cc-e918-442c-adf1-1c80cb3ba886 None None] MFA Rules not processed for user `26f33d48b0ec4aa2a104110e79bb9f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:12.607359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d9aac7cc-e918-442c-adf1-1c80cb3ba886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:12.685579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36922a39-7f08-4471-b567-ad5dc3c0feb7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.691139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.691830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.692115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.692496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.693676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.696328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.726186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 798/1623] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:12.727056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb61dc-1f1d-4cf0-97be-2ea3945c35bd None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.735775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 826/1624] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:12 2022] POST /identity/v3/projects => generated 404 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:12.741475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.742386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb61dc-1f1d-4cf0-97be-2ea3945c35bd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.742902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb61dc-1f1d-4cf0-97be-2ea3945c35bd None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.750794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 799/1625] 10.222.0.113 () {54 vars in 967 bytes} [Mon Jul 25 19:19:12 2022] GET /identity => generated 271 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:12.752973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb61dc-1f1d-4cf0-97be-2ea3945c35bd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:12.901034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce386b-08c9-48a6-860c-4d8655f495f7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.911553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb61dc-1f1d-4cf0-97be-2ea3945c35bd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:12.917311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.918061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.918399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.918684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.919742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31f620-eea5-4308-94c6-57fec5eac963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:12.919982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31f620-eea5-4308-94c6-57fec5eac963 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.920133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31f620-eea5-4308-94c6-57fec5eac963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.920482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31f620-eea5-4308-94c6-57fec5eac963 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:12.921842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31f620-eea5-4308-94c6-57fec5eac963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:12.926053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31f620-eea5-4308-94c6-57fec5eac963 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:12.936722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:12.980420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 827/1626] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:12 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:12.982893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:12.983448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:12.983958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.046742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:13.048912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:13.107639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.111182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.125635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:13.140486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 800/1627] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:13.142493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.157707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718fd56-97fe-4eb9-885d-c83c303e4456 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.163842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.165256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.165549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.165831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.167443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.169340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.184561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 828/1628] 10.222.0.113 () {58 vars in 1064 bytes} [Mon Jul 25 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:13.186194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.192951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 801/1629] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:13 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:13.199309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.204187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16107528-17db-4024-bcf7-e8a3d06c5a82 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.222849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.223680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.223994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.224384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.225631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330daf5-d738-4cf3-aacc-155013c97998 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.232422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.233796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.234088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.234471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] PATH_INFO: `/v3/projects/fd586efc53b34867b0d15c2d7a5ab41b/users/c427625b06ef4da8a7260c011cab96d4/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.268923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd586efc53b34867b0d15c2d7a5ab41b, user_id=c427625b06ef4da8a7260c011cab96d4, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.272427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.300881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 802/1630] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:13 2022] PUT /identity/v3/projects/fd586efc53b34867b0d15c2d7a5ab41b/users/c427625b06ef4da8a7260c011cab96d4/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:13.302433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.363473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.374768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.404901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 829/1631] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:13.407100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.421708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ade5-0d6f-46d5-8c8f-4e60594811ec service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.422090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc8dee-f3be-4a40-9ef9-c093cd406607 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.435114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.436021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.438535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.439466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.439989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.444956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.485809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 803/1632] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:13 2022] GET /identity/v3/roles => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:13.489869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.509697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cdee-74ff-48f8-80ab-c13cb22cc62c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.526096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8aca-781d-49c3-9c81-9ed63fdcc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.527077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8aca-781d-49c3-9c81-9ed63fdcc662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.527362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8aca-781d-49c3-9c81-9ed63fdcc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.527638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8aca-781d-49c3-9c81-9ed63fdcc662 admin admin] PATH_INFO: `/v3/projects/fd586efc53b34867b0d15c2d7a5ab41b/users/c427625b06ef4da8a7260c011cab96d4/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.529789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8aca-781d-49c3-9c81-9ed63fdcc662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd586efc53b34867b0d15c2d7a5ab41b, user_id=c427625b06ef4da8a7260c011cab96d4, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.544615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8aca-781d-49c3-9c81-9ed63fdcc662 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.546126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.547281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.547569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.547849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.569035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 804/1633] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:13 2022] PUT /identity/v3/projects/fd586efc53b34867b0d15c2d7a5ab41b/users/c427625b06ef4da8a7260c011cab96d4/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:13.580570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24882b9f-d05c-4367-892d-9bf1865456a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.581031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24882b9f-d05c-4367-892d-9bf1865456a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.581511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24882b9f-d05c-4367-892d-9bf1865456a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.640693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-24882b9f-d05c-4367-892d-9bf1865456a2 None None] MFA Rules not processed for user `c427625b06ef4da8a7260c011cab96d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:13.642185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24882b9f-d05c-4367-892d-9bf1865456a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:13.734063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:13.754162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:13.756113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:13.783932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 830/1634] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:13.808431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 805/1635] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:13.817184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:13.830853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d237fb9-afc7-4d61-b486-4e5142378ae8 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:13.887506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcefc65-d49e-4d5f-874b-4caa4e41890e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.888175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcefc65-d49e-4d5f-874b-4caa4e41890e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.888654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcefc65-d49e-4d5f-874b-4caa4e41890e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.890665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 806/1636] 10.222.0.113 () {54 vars in 967 bytes} [Mon Jul 25 19:19:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:13.905098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08de35-8b12-4084-bee7-ba237a5da29a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.905814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08de35-8b12-4084-bee7-ba237a5da29a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.906294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08de35-8b12-4084-bee7-ba237a5da29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:13.938702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9d08de35-8b12-4084-bee7-ba237a5da29a None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:13.940113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9d08de35-8b12-4084-bee7-ba237a5da29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:13.972522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:13.989319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e761595-5cb6-445d-bad5-cf939816dfdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:13.990007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e761595-5cb6-445d-bad5-cf939816dfdc service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:13.990402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e761595-5cb6-445d-bad5-cf939816dfdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:13.990707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e761595-5cb6-445d-bad5-cf939816dfdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.022885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e761595-5cb6-445d-bad5-cf939816dfdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.026023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e761595-5cb6-445d-bad5-cf939816dfdc service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.039822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 807/1637] 10.222.0.113 () {58 vars in 1064 bytes} [Mon Jul 25 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:14.042421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de011-ac8f-4b1c-9495-85c8c3557943 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.042977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de011-ac8f-4b1c-9495-85c8c3557943 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.043519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de011-ac8f-4b1c-9495-85c8c3557943 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.052347 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 808/1638] 10.222.0.113 () {54 vars in 917 bytes} [Mon Jul 25 19:19:14 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:14.054796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9bb2e-5c33-41bc-a38a-3d2b207854f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.055579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9bb2e-5c33-41bc-a38a-3d2b207854f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.056017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9bb2e-5c33-41bc-a38a-3d2b207854f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.062480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 831/1639] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:14.085509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2fb9bb2e-5c33-41bc-a38a-3d2b207854f1 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:14.086732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2fb9bb2e-5c33-41bc-a38a-3d2b207854f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:14.110973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 809/1640] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:14.146536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600f49-4360-4bbd-9066-7bc67eee8ef7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.146890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600f49-4360-4bbd-9066-7bc67eee8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.147135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600f49-4360-4bbd-9066-7bc67eee8ef7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.155253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 832/1641] 10.222.0.113 () {54 vars in 917 bytes} [Mon Jul 25 19:19:14 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:14.160683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.161045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.161498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.173589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86600f49-4360-4bbd-9066-7bc67eee8ef7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:14.210888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86600f49-4360-4bbd-9066-7bc67eee8ef7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:14.224958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:14.225673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.225960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.226246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.233244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:14.233244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:14.265315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.266804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.272371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 810/1642] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:14.304165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 833/1643] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:14.477674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:14.508223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967aea3-07b3-4f66-8035-d6fc554fc9d9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:14.520568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde61c4a-3dd1-43e7-9fb1-be79fdba7b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:14.523215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61c4a-3dd1-43e7-9fb1-be79fdba7b20 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:14.524235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61c4a-3dd1-43e7-9fb1-be79fdba7b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:14.524807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde61c4a-3dd1-43e7-9fb1-be79fdba7b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:14.563782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde61c4a-3dd1-43e7-9fb1-be79fdba7b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:14.567576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde61c4a-3dd1-43e7-9fb1-be79fdba7b20 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:14.621497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 811/1644] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:15.195342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:15.391444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0711e7-b7ad-4877-a21b-59b8041f591a service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:15.417239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:15.418635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:15.419740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:15.419871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] PATH_INFO: `/v3/users/4806a18af90f4292a9b1a801d4b21696` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:15.424379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4806a18af90f4292a9b1a801d4b21696)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:15.428397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: WARNING py.warnings [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:19:15.428397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: warnings.warn(msg) Jul 25 19:19:15.428397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: Jul 25 19:19:15.430385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:15.553587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4806a18af90f4292a9b1a801d4b21696'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.585630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4806a18af90f4292a9b1a801d4b21696'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.590714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4806a18af90f4292a9b1a801d4b21696'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.600837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4806a18af90f4292a9b1a801d4b21696'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.602421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4806a18af90f4292a9b1a801d4b21696'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:15.671250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 834/1645] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:15 2022] DELETE /identity/v3/users/4806a18af90f4292a9b1a801d4b21696 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:15.676229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a844d-d3f0-49f6-a376-1ef56e95acdd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:15.677759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a844d-d3f0-49f6-a376-1ef56e95acdd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:15.678473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a844d-d3f0-49f6-a376-1ef56e95acdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:15.724901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8e6a844d-d3f0-49f6-a376-1ef56e95acdd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:15.729773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e6a844d-d3f0-49f6-a376-1ef56e95acdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:15.989337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 812/1646] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:16.024706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:16.027958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:16.252029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012076dc-ec62-46a8-b146-3810ccface4b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:16.259990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:16.262771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:16.263458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:16.264144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:16.301991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:16.303740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:16.318980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:16.346424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:16.347727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:16.349890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:16.351498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 835/1647] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:16.407333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] MFA Rules not processed for user `87da6642d2d343a384663ea655c47fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:16.408835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:16.446312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:16.494915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:16.495196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 813/1648] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:16.496420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:16.535782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca1a48-cfdf-432e-818e-319aeb2af9ae service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:16.535782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:16.535782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:16.535782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:16.537633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:16.537633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:16.537633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:16.583890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:16.585005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 836/1649] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:16 2022] POST /identity/v3/projects => generated 404 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:19:16.602152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1727061-376b-4791-a48b-4ee55ed70934 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:16.796820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:16.799191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:16.799695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:16.811958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:16.814465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:16.818921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:16.889618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 814/1650] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:16 2022] POST /identity/v3/users => generated 309 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:16.893450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:16.915004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf215a1-5780-4a1e-8696-54f169ab14c6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:16.944477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:16.945224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:16.945515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:16.945803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:16.946563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:16.948243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:17.000342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:17.005757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 837/1651] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:16 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:17.021285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778be3-7d9d-48e5-b2bf-2d3cfddb9027 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:17.037634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:17.038585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:17.038871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:17.042047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] PATH_INFO: `/v3/projects/384334f83c754d9fa3551d0240c17faf/users/5bc08de4737346348eaf51138d240c99/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:17.089771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=384334f83c754d9fa3551d0240c17faf, user_id=5bc08de4737346348eaf51138d240c99, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:17.097513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:17.151022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 815/1652] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:16 2022] PUT /identity/v3/projects/384334f83c754d9fa3551d0240c17faf/users/5bc08de4737346348eaf51138d240c99/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:17.154662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:17.169362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e8a62-7b36-4b21-8218-694682a5e85f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:17.430468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:17.432197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:17.434474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:17.435783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:17.439872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:17.448545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:17.487824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 838/1653] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:17.493762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:17.513295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7aad31-5616-494e-96e6-8f3f7c294a7c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:17.542300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:17.543259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:17.543834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:17.544122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] PATH_INFO: `/v3/projects/384334f83c754d9fa3551d0240c17faf/users/5bc08de4737346348eaf51138d240c99/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:17.557469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=384334f83c754d9fa3551d0240c17faf, user_id=5bc08de4737346348eaf51138d240c99, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:17.560061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:17.603784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 816/1654] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:17 2022] PUT /identity/v3/projects/384334f83c754d9fa3551d0240c17faf/users/5bc08de4737346348eaf51138d240c99/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:18.263209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:18.270048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:18.295866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec8e9-e59e-461f-84ef-95feeb59ba0f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:18.482096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:18.483876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:18.484290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:18.484692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] PATH_INFO: `/v3/projects/d8627c72f1d74672ba936aca3b40cfac` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:18.487642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8627c72f1d74672ba936aca3b40cfac)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:18.491669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:18.609286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8627c72f1d74672ba936aca3b40cfac', 'request_id': 'req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.628567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8627c72f1d74672ba936aca3b40cfac', 'request_id': 'req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.653550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:18.662788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8627c72f1d74672ba936aca3b40cfac', 'request_id': 'req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.689468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] The token cache is being invalidate because project d8627c72f1d74672ba936aca3b40cfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:18.689894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.690758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.704090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 839/1655] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:18 2022] DELETE /identity/v3/projects/d8627c72f1d74672ba936aca3b40cfac => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:18.705929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:18.707928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:18.737527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39077-18fa-4f1e-8404-ede9794ac53b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:18.886341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:18.889359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:18.891615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:18.892307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] PATH_INFO: `/v3/users/c427625b06ef4da8a7260c011cab96d4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:18.896469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c427625b06ef4da8a7260c011cab96d4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:18.901291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:18.950499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:18.995555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c427625b06ef4da8a7260c011cab96d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.996988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c427625b06ef4da8a7260c011cab96d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:18.997770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c427625b06ef4da8a7260c011cab96d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:19.048505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c427625b06ef4da8a7260c011cab96d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:19.074863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-31e91cbf-8ee4-4475-8ac2-d3cf3896a19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c427625b06ef4da8a7260c011cab96d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:19.122822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 817/1656] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:18 2022] DELETE /identity/v3/users/c427625b06ef4da8a7260c011cab96d4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:21.094248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:21.095965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:21.127280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01087f-21ab-4d9f-84a6-03633a5fd1aa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:21.278154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:21.279300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:21.279700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:21.280050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] PATH_INFO: `/v3/users/0d89d5eb7ba647a6bd761ce8cdfa2469` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:21.282277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d89d5eb7ba647a6bd761ce8cdfa2469)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:21.284723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:21.390243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d89d5eb7ba647a6bd761ce8cdfa2469'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:21.438677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d89d5eb7ba647a6bd761ce8cdfa2469'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:21.439300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d89d5eb7ba647a6bd761ce8cdfa2469'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:21.456673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d89d5eb7ba647a6bd761ce8cdfa2469'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:21.457856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d89d5eb7ba647a6bd761ce8cdfa2469'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:21.482102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 840/1657] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:21 2022] DELETE /identity/v3/users/0d89d5eb7ba647a6bd761ce8cdfa2469 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:21.487557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:21.488049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:21.488475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:21.559270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:21.561413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:21.710704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 818/1658] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:21.833835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:21.835888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:22.043594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3a74e-08d2-45f4-a731-3b7c700dbe91 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:22.060018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94c660-f53b-49d1-859f-6179d2fbdeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:22.060975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94c660-f53b-49d1-859f-6179d2fbdeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:22.061440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94c660-f53b-49d1-859f-6179d2fbdeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:22.062115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94c660-f53b-49d1-859f-6179d2fbdeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:22.082335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94c660-f53b-49d1-859f-6179d2fbdeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:22.088659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94c660-f53b-49d1-859f-6179d2fbdeb8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:22.124585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 841/1659] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:22.647246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:22.650543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:22.671159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14271d9-7c5f-449d-9a70-34c3235adcae None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:22.701060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:22.705325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:22.712962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:22.713376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] PATH_INFO: `/v3/projects/fd586efc53b34867b0d15c2d7a5ab41b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:22.714851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd586efc53b34867b0d15c2d7a5ab41b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:22.715921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: WARNING py.warnings [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:19:22.715921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: warnings.warn(msg) Jul 25 19:19:22.715921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: Jul 25 19:19:22.724997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:22.860279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe36a8-ef13-4965-a16e-4b5b36c8fa28 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:22.860911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe36a8-ef13-4965-a16e-4b5b36c8fa28 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:22.867193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe36a8-ef13-4965-a16e-4b5b36c8fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:22.879105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd586efc53b34867b0d15c2d7a5ab41b', 'request_id': 'req-3dc562c1-34ba-47b3-8266-39e1fe269736'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:22.897195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd586efc53b34867b0d15c2d7a5ab41b', 'request_id': 'req-3dc562c1-34ba-47b3-8266-39e1fe269736'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:22.907286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd586efc53b34867b0d15c2d7a5ab41b', 'request_id': 'req-3dc562c1-34ba-47b3-8266-39e1fe269736'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:22.936295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] The token cache is being invalidate because project fd586efc53b34867b0d15c2d7a5ab41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:22.936589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:22.937522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3dc562c1-34ba-47b3-8266-39e1fe269736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:22.944218 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 819/1660] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:22 2022] DELETE /identity/v3/projects/fd586efc53b34867b0d15c2d7a5ab41b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:22.946365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f91f63-a770-4997-8cc9-df89237a40d0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:22.947395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f91f63-a770-4997-8cc9-df89237a40d0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:22.947395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f91f63-a770-4997-8cc9-df89237a40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:22.950708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:22.964445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2efe36a8-ef13-4965-a16e-4b5b36c8fa28 None None] MFA Rules not processed for user `ae9d01db3b9c488a9e16da9f8663281e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:22.967592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2efe36a8-ef13-4965-a16e-4b5b36c8fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:22.985023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-80f91f63-a770-4997-8cc9-df89237a40d0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:22.986885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-80f91f63-a770-4997-8cc9-df89237a40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:23.023008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:23.083367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 820/1661] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:23.085486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.085777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.086060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.090859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 842/1662] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:23.103977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.105265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.106189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.126256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:23.127601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:23.145744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 821/1663] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:23.146406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.149790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] MFA Rules not processed for user `ae9d01db3b9c488a9e16da9f8663281e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:23.152280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:23.171277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 843/1664] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:23.183247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.186194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0877e-36db-45a6-910f-bc2098910c18 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.187534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:23.194693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.195438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.195766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.196236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.197446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:23.197806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.200005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.226137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 822/1665] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:23.226137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.240683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353c161-e4de-453b-a202-c6efed148203 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.250869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.252118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.252585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.253439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.254615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.257939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.318568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 823/1666] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:23 2022] POST /identity/v3/projects => generated 378 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:23.319609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.384728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4ceef-1aa6-45fe-aa27-641fa8ae5fc0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.431266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc40d-c264-4479-baf3-ab7e01a62ad4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.440362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.441071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.443702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.444105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.444860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.449638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.497549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 824/1667] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:23 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:23.502246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.519183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56aa63-4cc9-48cf-b299-f6d2822c0412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.520515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56aa63-4cc9-48cf-b299-f6d2822c0412 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.521224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56aa63-4cc9-48cf-b299-f6d2822c0412 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.521568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56aa63-4cc9-48cf-b299-f6d2822c0412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.524230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba005b49-7d85-4584-9481-c8c1c4579e10 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.540574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.541367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.541660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.541942 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.542718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.545635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.570584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:23.582692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 825/1668] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:23 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:23.583698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.610923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e3db4-04f3-4ade-9396-69948c0f205c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.627850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.627850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.628244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.628505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.629296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.631153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.659670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 826/1669] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:23 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:23.665033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56aa63-4cc9-48cf-b299-f6d2822c0412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.665674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:23.666847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56aa63-4cc9-48cf-b299-f6d2822c0412 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.696518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834003-33e9-4ce0-be86-43a755507de3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:23.699155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 844/1670] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:23.720581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:23.721628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.721979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.722341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] PATH_INFO: `/v3/projects/93616753e98e443e99323b1ffc17584f/users/55e1ba31a1124de29061a9e11fb45500/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.746587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93616753e98e443e99323b1ffc17584f, user_id=55e1ba31a1124de29061a9e11fb45500, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:23.750128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:23.773810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 827/1671] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:23 2022] PUT /identity/v3/projects/93616753e98e443e99323b1ffc17584f/users/55e1ba31a1124de29061a9e11fb45500/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:23.786435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:23.788460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:23.790019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:23.888364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] MFA Rules not processed for user `55e1ba31a1124de29061a9e11fb45500`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:23.892673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:24.049283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 845/1672] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:24.054850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:24.167853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:24.282767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bee5-ea4a-4d9a-b120-9b78091a2e29 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:24.297253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610821d-0167-47fe-9f84-a008c633a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:24.298018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610821d-0167-47fe-9f84-a008c633a246 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.298314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610821d-0167-47fe-9f84-a008c633a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.298597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610821d-0167-47fe-9f84-a008c633a246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:24.313925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610821d-0167-47fe-9f84-a008c633a246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:24.323186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610821d-0167-47fe-9f84-a008c633a246 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:24.395120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 828/1673] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:24 2022] POST /identity/v3/projects => generated 378 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:24.396560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:24.417700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdf97b-deef-4cf6-bb57-9d17b2f206d1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:24.586372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:24.587627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.588006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.589176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:24.590855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:24.594718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:24.646250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.646899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.647409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:24.652173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 846/1674] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:24 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:24.655143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:24.695857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a049d8-3461-4647-87c1-646b4eaeff10 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:24.700795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:24.702899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.704785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.704785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:24.708415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:24.715038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:24.744392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] MFA Rules not processed for user `5bc08de4737346348eaf51138d240c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:24.744987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 847/1675] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:24 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:24.747770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:24.750786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:24.758362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:24.789261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada77721-b8a7-489a-a1b0-b517365b22c8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:24.799706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:24.800703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.800985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.801534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] PATH_INFO: `/v3/projects/f7491e24c4fb4fb09238a2e66fd7686e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:24.805669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7491e24c4fb4fb09238a2e66fd7686e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:24.807766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:24.892641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:24.927838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7491e24c4fb4fb09238a2e66fd7686e', 'request_id': 'req-bb48702b-8d2d-40d8-ad0e-86a573db9139'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:24.938936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7491e24c4fb4fb09238a2e66fd7686e', 'request_id': 'req-bb48702b-8d2d-40d8-ad0e-86a573db9139'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:24.948166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7491e24c4fb4fb09238a2e66fd7686e', 'request_id': 'req-bb48702b-8d2d-40d8-ad0e-86a573db9139'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:24.963987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] The token cache is being invalidate because project f7491e24c4fb4fb09238a2e66fd7686e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:24.964972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:24.969956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 829/1676] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:24 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:24.970450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bb48702b-8d2d-40d8-ad0e-86a573db9139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:24.971109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:24.974542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 848/1677] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:24 2022] DELETE /identity/v3/projects/f7491e24c4fb4fb09238a2e66fd7686e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:24.976467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e47e5-31de-4997-b39c-87d4f02d09bc None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.976899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e47e5-31de-4997-b39c-87d4f02d09bc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.977361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e47e5-31de-4997-b39c-87d4f02d09bc None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:24.980170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 849/1678] 10.222.0.113 () {54 vars in 917 bytes} [Mon Jul 25 19:19:24 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:24.981740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae69ce2-fc91-4463-98d4-be16a3e89556 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:24.982529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae69ce2-fc91-4463-98d4-be16a3e89556 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:24.984216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae69ce2-fc91-4463-98d4-be16a3e89556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.006602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff2bd-e9af-4af0-93c6-c52daa4403e3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:25.021901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5ae69ce2-fc91-4463-98d4-be16a3e89556 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:25.026608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5ae69ce2-fc91-4463-98d4-be16a3e89556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.123072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbae11-af70-469f-bfac-87733f5d3cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:25.123985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbae11-af70-469f-bfac-87733f5d3cad admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.124271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbae11-af70-469f-bfac-87733f5d3cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.124545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbae11-af70-469f-bfac-87733f5d3cad admin admin] PATH_INFO: `/v3/projects/65b52232dc3c47cc9bc9a7b6261f5297/users/37ec00d05e714940a3592ca56e75a062/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.158402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbae11-af70-469f-bfac-87733f5d3cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b52232dc3c47cc9bc9a7b6261f5297, user_id=37ec00d05e714940a3592ca56e75a062, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:25.161451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbae11-af70-469f-bfac-87733f5d3cad admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:25.165861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 850/1679] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:25.167333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.167769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.168054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.207257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 830/1680] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:24 2022] PUT /identity/v3/projects/65b52232dc3c47cc9bc9a7b6261f5297/users/37ec00d05e714940a3592ca56e75a062/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:25.208903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.209230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.209785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.225678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:25.227997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.258176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:25.260671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.298403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:25.424154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 831/1681] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:25.429283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:25.429824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.452973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0bf6f-58df-40a6-b6bb-750a0513ce77 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:25.468628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:25.469407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.469690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 851/1682] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:25.470130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.470130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.470575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:25.470855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:25.474135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:25.474266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.500872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 832/1683] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:25.503426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:25.508042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172fc3a-9dfe-441f-b3df-6844c6e6c91e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:25.523697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:25.524672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.525030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.525587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] PATH_INFO: `/v3/users/a35d74ff357b45fc86db211bb0034541` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.527604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35d74ff357b45fc86db211bb0034541)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:25.528952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204ba2-e405-42ee-8c6e-869ac5f04e16 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:25.532580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:25.543356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:25.544456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.544977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.545576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.547189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:25.549621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:25.554162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:25.598617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 833/1684] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:25.603656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:25.627841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84bd15-940f-4a38-a969-d954933f472e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:25.640234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:25.644977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:25.645631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:25.646140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] PATH_INFO: `/v3/projects/65b52232dc3c47cc9bc9a7b6261f5297/users/37ec00d05e714940a3592ca56e75a062/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:25.652293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b52232dc3c47cc9bc9a7b6261f5297, user_id=37ec00d05e714940a3592ca56e75a062, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:25.652606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35d74ff357b45fc86db211bb0034541'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:25.655981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:25.664948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:25.685822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35d74ff357b45fc86db211bb0034541'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:25.686587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35d74ff357b45fc86db211bb0034541'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:25.689306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 834/1685] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:25 2022] PUT /identity/v3/projects/65b52232dc3c47cc9bc9a7b6261f5297/users/37ec00d05e714940a3592ca56e75a062/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:25.691983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:25.700467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35d74ff357b45fc86db211bb0034541'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:25.701209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35d74ff357b45fc86db211bb0034541'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:25.701482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.738582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 852/1686] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:25 2022] DELETE /identity/v3/users/a35d74ff357b45fc86db211bb0034541 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:25.741804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:25.746766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:25.883283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0226-bf52-47ce-9b96-aacfb6d81fd8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.027181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be1911-19d8-43e5-a94f-f2a44e0df8a6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.032562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.033885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.035849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.036430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.046776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84933abb-fad8-4e94-9df3-5335529bc84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.047483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933abb-fad8-4e94-9df3-5335529bc84c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.047767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933abb-fad8-4e94-9df3-5335529bc84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.048263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933abb-fad8-4e94-9df3-5335529bc84c admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.058721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.060478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84933abb-fad8-4e94-9df3-5335529bc84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.069092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84933abb-fad8-4e94-9df3-5335529bc84c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:26.093309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.099735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76046b-dba2-4a96-b3b5-b46e6ef9e367 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:26.151268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 835/1687] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:26.154876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.156950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 853/1688] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:25 2022] POST /identity/v3/projects => generated 364 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:26.162169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.162450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.162727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.164021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.164660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.250302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] MFA Rules not processed for user `37ec00d05e714940a3592ca56e75a062`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:26.276620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:26.278239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.290545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.413221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:26.508695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 836/1689] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:26.510433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:26.556945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 854/1690] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:26.557893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:26.559220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.667342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ba07-746f-48a1-af77-d56e34d3b2f6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.672891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.674020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.674524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.675035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.676591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.679560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:26.714630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 837/1691] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:26 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:26.715941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:26.718860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.739250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe1a12-13f2-40ee-bb24-c9e1ce59faa3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.764229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.764834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.765127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.765405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.767317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.788574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:26.866901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52c197-6b95-4881-abfa-fe3647db6715 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.877438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.882905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.883557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.884599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.906568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.910182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:26.919429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.921204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52a1a7-351c-4ed3-a17f-5e97d2e6a864 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:26.944560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 838/1692] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:26.945656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:26.962410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774c679-db20-4d36-957d-8ddc19d50728 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.966820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 855/1693] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:26.968507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f08fb8-8730-4a8e-bd2d-b78440527a83 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.968948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f08fb8-8730-4a8e-bd2d-b78440527a83 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.969383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f08fb8-8730-4a8e-bd2d-b78440527a83 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.970895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 856/1694] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:19:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:26.982818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.984784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.985382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.989313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.990090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.991872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:27.013977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20cb9-3bda-449e-8c41-adca000655c0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.016410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20cb9-3bda-449e-8c41-adca000655c0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.017090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc20cb9-3bda-449e-8c41-adca000655c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.022685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 839/1695] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:26 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:27.024089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:27.047384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca55c0-2937-4c09-a4d1-ec7e693734e9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:27.059934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:27.062633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.065200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.065622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.067293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:27.069135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:27.085311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ddc20cb9-3bda-449e-8c41-adca000655c0 None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:27.087205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ddc20cb9-3bda-449e-8c41-adca000655c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:27.100635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 840/1696] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:27 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:27.103202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:27.138809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62144902-128e-43be-ab84-c021e5fa7f8d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:27.147315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dae9-00e8-4b50-9957-30474dd02165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:27.151878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dae9-00e8-4b50-9957-30474dd02165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.152203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dae9-00e8-4b50-9957-30474dd02165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.152506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dae9-00e8-4b50-9957-30474dd02165 admin admin] PATH_INFO: `/v3/projects/21578e8cc7db47ccb0b27d005df224bf/users/1123498ef44e432db2d064ed3db1e2cb/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.197005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dae9-00e8-4b50-9957-30474dd02165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21578e8cc7db47ccb0b27d005df224bf, user_id=1123498ef44e432db2d064ed3db1e2cb, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:27.199804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dae9-00e8-4b50-9957-30474dd02165 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:27.235842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 841/1697] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:27 2022] PUT /identity/v3/projects/21578e8cc7db47ccb0b27d005df224bf/users/1123498ef44e432db2d064ed3db1e2cb/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:27.237591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.237886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.238163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.282931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] MFA Rules not processed for user `1123498ef44e432db2d064ed3db1e2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:27.285860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:27.286030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 857/1698] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:27.301870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:27.341365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c330ae-4aec-46de-ae50-b989dae80aa5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.342696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c330ae-4aec-46de-ae50-b989dae80aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.343046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c330ae-4aec-46de-ae50-b989dae80aa5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.346307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 858/1699] 10.222.0.113 () {54 vars in 966 bytes} [Mon Jul 25 19:19:27 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:27.388148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.389787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.390114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.437676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:27.439046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:27.540822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 842/1700] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:27.548664 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:27.596885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 859/1701] 10.222.0.113 () {58 vars in 1063 bytes} [Mon Jul 25 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:27.605973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:27.636517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1419e7d-4c40-4577-9e03-aaca3aa88eed None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:27.662814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:27.663502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.663789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.664168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.695929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:27.697620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:27.742719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 860/1702] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:27.834384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c87cbe-de87-43cf-9226-bc8ce127323a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:27.844855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:27.845775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:27.846173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:27.846554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:27.847424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:27.849689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:27.924667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 843/1703] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:27 2022] POST /identity/v3/projects => generated 364 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:27.925393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:27.947374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2549c-cf49-4e4d-8190-1305476a87e7 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:28.119037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:28.234003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:28.234765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.235155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.235474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.236304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:28.241039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:28.293028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:28.319214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 861/1704] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:27 2022] POST /identity/v3/users => generated 289 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:28.323929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:28.365676 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2c99-fea6-47c6-888f-79819ac91e8e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:28.381763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:28.382641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.383053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.383435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.384356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:28.387436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:28.419703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 862/1705] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:28 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:28.420996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:28.449066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6bfe-54d3-4ef3-8b74-54d52fecd73f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:28.454703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:28.456310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.456822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.457411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] PATH_INFO: `/v3/projects/50cafff8792d437f953f76b1a9e2f6d4/users/cb19d221e88d4a0f92a747922f26262e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.533088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09367c-f32d-4faa-bf3c-348e05f8698a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:28.541845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cafff8792d437f953f76b1a9e2f6d4, user_id=cb19d221e88d4a0f92a747922f26262e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:28.544184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:28.546052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.546357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.547865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.551042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:28.554765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:28.590768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:28.594077 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:28.597479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 863/1706] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:28 2022] PUT /identity/v3/projects/50cafff8792d437f953f76b1a9e2f6d4/users/cb19d221e88d4a0f92a747922f26262e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:28.598743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:28.608033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 844/1707] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:28.737964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e70aa-e0e0-4933-a036-f1beda1c36b9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:28.746816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd35e4-9131-464d-b169-ef9ecf47b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:28.749035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd35e4-9131-464d-b169-ef9ecf47b183 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.749573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd35e4-9131-464d-b169-ef9ecf47b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.750127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd35e4-9131-464d-b169-ef9ecf47b183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.751329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd35e4-9131-464d-b169-ef9ecf47b183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:28.753489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd35e4-9131-464d-b169-ef9ecf47b183 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:28.768958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 864/1708] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:28 2022] GET /identity/v3/roles => generated 1427 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:28.774248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:28.797000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ddcc-7ed1-4ebb-9f58-b4776fe1d9fc service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:28.812616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:28.813724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.814133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.814369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] PATH_INFO: `/v3/projects/50cafff8792d437f953f76b1a9e2f6d4/users/cb19d221e88d4a0f92a747922f26262e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.824252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cafff8792d437f953f76b1a9e2f6d4, user_id=cb19d221e88d4a0f92a747922f26262e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:28.827028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:28.842700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 845/1709] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:28 2022] PUT /identity/v3/projects/50cafff8792d437f953f76b1a9e2f6d4/users/cb19d221e88d4a0f92a747922f26262e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:28.854350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:28.854687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:28.854970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:28.924600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:28.927654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] MFA Rules not processed for user `cb19d221e88d4a0f92a747922f26262e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:28.929680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:28.951279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:29.029851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 865/1710] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:29.043603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:29.045431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:29.060454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:29.087006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48912-89fd-4a6e-bb90-8fb600f164f5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:29.104785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:29.105456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:29.105781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:29.106118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:29.159848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b3c3-84b4-40a1-be9f-74c413df77c2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:29.172302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:29.174157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:29.175548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:29.176816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:29.203321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:29.211035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:29.300578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:29.303039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:29.309709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 866/1711] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:29.312083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:29.315544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:29.317516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 846/1712] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:29.318601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:29.320105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:29.484634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1bcf-9a57-4445-8616-76291f28e2fb service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:29.489569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:29.490630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:29.490913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:29.491184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] PATH_INFO: `/v3/projects/6c9f6e769984407a8f84b3ea1f4584b5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:29.492498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9f6e769984407a8f84b3ea1f4584b5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:29.494510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:29.519008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1595-6cad-4a53-972e-0e50014e58f8 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:29.565031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:29.567311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:29.567669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:29.567985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] PATH_INFO: `/v3/users/87da6642d2d343a384663ea655c47fec` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:29.579001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87da6642d2d343a384663ea655c47fec)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:29.589700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:29.648230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9f6e769984407a8f84b3ea1f4584b5', 'request_id': 'req-898266cd-3afd-415b-8b60-4784802d8d05'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.675386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9f6e769984407a8f84b3ea1f4584b5', 'request_id': 'req-898266cd-3afd-415b-8b60-4784802d8d05'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.700575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9f6e769984407a8f84b3ea1f4584b5', 'request_id': 'req-898266cd-3afd-415b-8b60-4784802d8d05'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.786518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] The token cache is being invalidate because project 6c9f6e769984407a8f84b3ea1f4584b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:29.795645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.797665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-898266cd-3afd-415b-8b60-4784802d8d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.804370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 867/1713] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:29 2022] DELETE /identity/v3/projects/6c9f6e769984407a8f84b3ea1f4584b5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:29.809717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:29.810131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:29.810884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:29.815216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87da6642d2d343a384663ea655c47fec'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.819626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87da6642d2d343a384663ea655c47fec'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.821458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87da6642d2d343a384663ea655c47fec'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.873591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:29.880272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87da6642d2d343a384663ea655c47fec'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.929514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:29.931337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:29.935398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-79f393ce-fdbc-4995-88f4-c7996b9381b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87da6642d2d343a384663ea655c47fec'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:29.994007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 847/1714] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:29 2022] DELETE /identity/v3/users/87da6642d2d343a384663ea655c47fec => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:30.127849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:30.264441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 868/1715] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:30.267531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:30.268016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:30.268434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:30.314662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:30.316138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:30.580060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 848/1716] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:30.581420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:30.594191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed909e3-bbb7-4040-9db8-1883a2261054 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:30.642959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:30.643932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:30.644431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:30.645292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:30.647345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:30.653597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:30.657963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:30.716602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 869/1717] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:30.721608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:30.760749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc239e05-621e-40ea-a4e4-96504f577be7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:30.775245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:30.776057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:30.776416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:30.776767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:30.777586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:30.779828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:30.884287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 849/1718] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:30 2022] POST /identity/v3/projects => generated 366 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:30.885740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:30.899652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b04f0a-f105-41ad-bcc1-43a52f4db3d5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:31.008684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:31.009567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.009941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.010316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.011227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:31.013376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:31.082806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:31.084380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 870/1719] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:30 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:31.101239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa59b-c2e5-4787-a940-044c7c869991 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:31.134442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:31.135774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.136743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.137196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.138167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:31.140230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:31.197208 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 850/1720] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:31 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:31.197406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:31.220406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec1ffa-a606-4f65-8eda-48bf62dd7b57 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:31.255148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c851a28-4b81-4b9d-9c3e-cfc1971fc937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:31.255994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851a28-4b81-4b9d-9c3e-cfc1971fc937 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.256595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851a28-4b81-4b9d-9c3e-cfc1971fc937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.257442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851a28-4b81-4b9d-9c3e-cfc1971fc937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.261336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851a28-4b81-4b9d-9c3e-cfc1971fc937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:31.266193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851a28-4b81-4b9d-9c3e-cfc1971fc937 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:31.324104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:31.349541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11804-df5d-45ea-ad25-d8d044645c8e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:31.352014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 871/1721] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:31 2022] GET /identity/v3/roles => generated 1427 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:19:31.378933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:31.380296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.380589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.380880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] PATH_INFO: `/v3/projects/2c0f27b8217141448c3e830e519118e2/users/339d760ac9634c8e89227c11335415fc/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.459830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0f27b8217141448c3e830e519118e2, user_id=339d760ac9634c8e89227c11335415fc, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:31.463163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:31.524539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 851/1722] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:31 2022] PUT /identity/v3/projects/2c0f27b8217141448c3e830e519118e2/users/339d760ac9634c8e89227c11335415fc/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:31.527742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.528090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.528459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.538905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:31.546882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:31.623865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] MFA Rules not processed for user `339d760ac9634c8e89227c11335415fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:31.625789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:31.787742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0466010-b378-4e22-ae23-3eacf043dbfb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:31.799213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:31.800316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.800755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.801296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] PATH_INFO: `/v3/users/1123498ef44e432db2d064ed3db1e2cb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.814177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1123498ef44e432db2d064ed3db1e2cb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:31.816995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:31.868445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 872/1723] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:31.870392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:31.873382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:31.903812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:31.909528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c56d-c803-462a-97bb-24388d00556a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:31.925264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:31.928097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:31.928746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:31.929389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] PATH_INFO: `/v3/projects/faa1a7554548484e873349e1bc29fb1d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:31.932390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa1a7554548484e873349e1bc29fb1d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:31.938602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:31.963611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1123498ef44e432db2d064ed3db1e2cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:31.964562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1123498ef44e432db2d064ed3db1e2cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:31.965390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1123498ef44e432db2d064ed3db1e2cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.001854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1123498ef44e432db2d064ed3db1e2cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.036355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-212098e9-05d7-4a90-a8b6-8d11eecf1873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1123498ef44e432db2d064ed3db1e2cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.072696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 852/1724] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:31 2022] DELETE /identity/v3/users/1123498ef44e432db2d064ed3db1e2cb => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:32.072696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916c3d-00d7-42a0-b7f8-9b8b68953d85 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:32.072696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916c3d-00d7-42a0-b7f8-9b8b68953d85 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:32.072696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916c3d-00d7-42a0-b7f8-9b8b68953d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:32.076125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:32.117826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa1a7554548484e873349e1bc29fb1d', 'request_id': 'req-08f9a9e5-4031-4269-92c4-6bfaa47c067e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.124644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-82916c3d-00d7-42a0-b7f8-9b8b68953d85 None None] MFA Rules not processed for user `113a0a0591384937ae2408f468be8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:32.125968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-82916c3d-00d7-42a0-b7f8-9b8b68953d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:32.134739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa1a7554548484e873349e1bc29fb1d', 'request_id': 'req-08f9a9e5-4031-4269-92c4-6bfaa47c067e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.145287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa1a7554548484e873349e1bc29fb1d', 'request_id': 'req-08f9a9e5-4031-4269-92c4-6bfaa47c067e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.174629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] The token cache is being invalidate because project faa1a7554548484e873349e1bc29fb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:32.174925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.175683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.177524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 873/1725] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:31 2022] DELETE /identity/v3/projects/faa1a7554548484e873349e1bc29fb1d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:32.181804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:32.186192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:32.363160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 853/1726] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:32.367041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:32.367665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:32.369308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:32.399547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:32.400875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:32.404365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a9e5-4031-4269-92c4-6bfaa47c067e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:32.413455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 854/1727] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:32.416694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:32.416694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:32.416694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:32.416694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:32.417653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:32.417817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:32.419701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:32.423272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:32.444753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc947625-810b-4d76-937f-bd09b9118342 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:32.459327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:32.460923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:32.461459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:32.462294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] PATH_INFO: `/v3/users/5bc08de4737346348eaf51138d240c99` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:32.472301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc08de4737346348eaf51138d240c99)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:32.477022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:32.489147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 874/1728] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:32 2022] POST /identity/v3/projects => generated 366 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:32.489147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:32.492656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:32.618504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc08de4737346348eaf51138d240c99'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.619906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc08de4737346348eaf51138d240c99'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.620915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc08de4737346348eaf51138d240c99'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.665947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc08de4737346348eaf51138d240c99'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.713228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc08de4737346348eaf51138d240c99'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:32.760759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:32.794617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 855/1729] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:32 2022] DELETE /identity/v3/users/5bc08de4737346348eaf51138d240c99 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:32.796017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:32.800278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:32.846063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366352-3a14-45a8-9cdd-db73a042211d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.002429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a045a-7501-4427-a9f8-69726a3567f3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.007936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.009896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.010188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.010744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.012811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:33.017943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:33.104876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.106419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.115899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.117099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.117418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.117698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.118346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 856/1730] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:33.119224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:33.120596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:33.133268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:33.149885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7c6dd-e92e-46d7-bc69-e432ea0224ad service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.160803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af093b02-93a3-457b-a883-246b8fadc2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.161883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af093b02-93a3-457b-a883-246b8fadc2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.162538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af093b02-93a3-457b-a883-246b8fadc2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.162831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af093b02-93a3-457b-a883-246b8fadc2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.163551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af093b02-93a3-457b-a883-246b8fadc2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.166160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af093b02-93a3-457b-a883-246b8fadc2c1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.202204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 857/1731] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:33 2022] POST /identity/v3/users => generated 290 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:33.203791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.204133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.204538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.322454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.325854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.342364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 875/1732] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 856 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:33.343659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:33.358269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:33.359641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:33.367171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc31ef3-772b-4f1e-bfc3-86e3b163d9f8 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.382057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.383489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.383843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.384258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.386393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.388609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.439642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 876/1733] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:33 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:33.440656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:33.458005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005437-b483-4403-87b4-5ab5710d6778 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.477418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10b07e-f73a-47ad-b310-c1c2b2a8f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.478851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10b07e-f73a-47ad-b310-c1c2b2a8f777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.479514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10b07e-f73a-47ad-b310-c1c2b2a8f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.482071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10b07e-f73a-47ad-b310-c1c2b2a8f777 admin admin] PATH_INFO: `/v3/projects/badaf6569bd842ecaaed8325c94c983d/users/8243cf2096bb461081277ecc5748b19e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.546091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10b07e-f73a-47ad-b310-c1c2b2a8f777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badaf6569bd842ecaaed8325c94c983d, user_id=8243cf2096bb461081277ecc5748b19e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.556097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10b07e-f73a-47ad-b310-c1c2b2a8f777 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.558757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:33.595234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 858/1734] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:33.596640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 877/1735] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:33 2022] PUT /identity/v3/projects/badaf6569bd842ecaaed8325c94c983d/users/8243cf2096bb461081277ecc5748b19e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:33.600821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:33.630830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b42638-114a-4193-96d6-5038b9613ca3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.785630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.785950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.786234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.815134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.816581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.818268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.818764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.820445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.825569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.875626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 859/1736] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:33 2022] GET /identity/v3/roles => generated 1427 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:33.881394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:33.893804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] MFA Rules not processed for user `f99afdfcdd32429f88a03a06dd71453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:33.905389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:33.921257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63533-c62f-4ceb-b7d0-41c6eeca165e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:33.931549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:33.932827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:33.933281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:33.935451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] PATH_INFO: `/v3/projects/badaf6569bd842ecaaed8325c94c983d/users/8243cf2096bb461081277ecc5748b19e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:33.938499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badaf6569bd842ecaaed8325c94c983d, user_id=8243cf2096bb461081277ecc5748b19e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:33.943493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:33.961437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 860/1737] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:33 2022] PUT /identity/v3/projects/badaf6569bd842ecaaed8325c94c983d/users/8243cf2096bb461081277ecc5748b19e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:33.962764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:33.964785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:34.055214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 878/1738] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:34.056104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:34.058196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:34.082218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8118f7-338f-476b-a7c6-aceb2bc0b3c4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:34.165971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:34.229173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:34.230554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:34.231219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:34.232420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] PATH_INFO: `/v3/projects/384334f83c754d9fa3551d0240c17faf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:34.233806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384334f83c754d9fa3551d0240c17faf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:34.236456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:34.259738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6c9e-74d7-44dd-931d-e300eb7a19a4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:34.289101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba5fb-9384-4727-b5b8-42ac4d248c2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:34.297394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba5fb-9384-4727-b5b8-42ac4d248c2e service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:34.297816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba5fb-9384-4727-b5b8-42ac4d248c2e service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:34.298112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba5fb-9384-4727-b5b8-42ac4d248c2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:34.360376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384334f83c754d9fa3551d0240c17faf', 'request_id': 'req-a8074f16-1732-45cf-ad25-ebc9fe466705'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:34.381968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384334f83c754d9fa3551d0240c17faf', 'request_id': 'req-a8074f16-1732-45cf-ad25-ebc9fe466705'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:34.396075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384334f83c754d9fa3551d0240c17faf', 'request_id': 'req-a8074f16-1732-45cf-ad25-ebc9fe466705'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:34.432702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] The token cache is being invalidate because project 384334f83c754d9fa3551d0240c17faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:34.432898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:34.436161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ba5fb-9384-4727-b5b8-42ac4d248c2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:34.436371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:34.440474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ba5fb-9384-4727-b5b8-42ac4d248c2e service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:34.440889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 879/1739] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:34 2022] DELETE /identity/v3/projects/384334f83c754d9fa3551d0240c17faf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:34.449044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:34.455653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 861/1740] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:19:34.457891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:34.457980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:34.458125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:34.458586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:34.474725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:34.533084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] MFA Rules not processed for user `8243cf2096bb461081277ecc5748b19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:34.539863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:34.723236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074f16-1732-45cf-ad25-ebc9fe466705 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:34.742567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:34.743948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:34.744412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:34.752546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] PATH_INFO: `/v3/users/55e1ba31a1124de29061a9e11fb45500` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:34.764633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e1ba31a1124de29061a9e11fb45500)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:34.786534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:34.981866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 862/1741] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:34.981866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:34.994043 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:35.030655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e1ba31a1124de29061a9e11fb45500'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.090645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e1ba31a1124de29061a9e11fb45500'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.091943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e1ba31a1124de29061a9e11fb45500'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.094095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:35.116069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e1ba31a1124de29061a9e11fb45500'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.117079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f9086f12-7c88-4335-867d-47341936aa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e1ba31a1124de29061a9e11fb45500'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.173452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 880/1742] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:34 2022] DELETE /identity/v3/users/55e1ba31a1124de29061a9e11fb45500 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:35.177142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:35.177487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:35.177775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:35.269460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:35.279515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:35.383355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f461b6-4440-40d7-b02a-72c649328cc2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:35.533735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 881/1743] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:35.543483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:35.547725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:35.587608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270eac-7d3b-4776-87a5-d1d199caae14 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:35.600233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:35.613654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:35.616208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:35.621530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] PATH_INFO: `/v3/projects/21578e8cc7db47ccb0b27d005df224bf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:35.625056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21578e8cc7db47ccb0b27d005df224bf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:35.630978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:35.678750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:35.687169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:35.687526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:35.687746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:35.701081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:35.757450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:35.831399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:35.833728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:35.846969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 863/1744] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:35.848621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:35.850408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:35.931059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21578e8cc7db47ccb0b27d005df224bf', 'request_id': 'req-eff1cb07-5bb3-4241-8e7f-d7fd73966939'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.949480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21578e8cc7db47ccb0b27d005df224bf', 'request_id': 'req-eff1cb07-5bb3-4241-8e7f-d7fd73966939'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:35.984022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21578e8cc7db47ccb0b27d005df224bf', 'request_id': 'req-eff1cb07-5bb3-4241-8e7f-d7fd73966939'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.022723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] The token cache is being invalidate because project 21578e8cc7db47ccb0b27d005df224bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:36.023554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.024497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eff1cb07-5bb3-4241-8e7f-d7fd73966939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.027933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 882/1745] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:35 2022] DELETE /identity/v3/projects/21578e8cc7db47ccb0b27d005df224bf => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:36.029813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe06b-196b-450c-9b2b-15533880c0ff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:36.033162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe06b-196b-450c-9b2b-15533880c0ff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:36.034773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe06b-196b-450c-9b2b-15533880c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:36.035240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effef0f-49cb-4480-9eb7-4ec045034116 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:36.121690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a88fe06b-196b-450c-9b2b-15533880c0ff None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:36.122972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a88fe06b-196b-450c-9b2b-15533880c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:36.292703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:36.292703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:36.292703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:36.292703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:36.296848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:36.396646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 883/1746] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:36.400533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e77e13-90b7-4ec0-9194-41e7aeead938 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:36.402305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e77e13-90b7-4ec0-9194-41e7aeead938 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:36.403848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e77e13-90b7-4ec0-9194-41e7aeead938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:36.469792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:36.492988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e6e77e13-90b7-4ec0-9194-41e7aeead938 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:36.497479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e6e77e13-90b7-4ec0-9194-41e7aeead938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:36.529269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 884/1747] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:36.537399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:36.539648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:36.541722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:36.606227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:36.607910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:36.617750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:36.621433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:36.636064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 864/1748] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:36.637019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:36.643197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:36.682674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756d4-64ec-4fdc-881f-718668bdc797 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:36.698555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:36.700209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:36.700209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:36.700513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] PATH_INFO: `/v3/users/47d13ebf2e9643f69077104e88347edc` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:36.705493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d13ebf2e9643f69077104e88347edc)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:36.713020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:36.780360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:36.826628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d13ebf2e9643f69077104e88347edc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.833582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d13ebf2e9643f69077104e88347edc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.834341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d13ebf2e9643f69077104e88347edc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.892105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 885/1749] 10.222.0.59 () {58 vars in 1019 bytes} [Mon Jul 25 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:36.893138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:36.893348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d13ebf2e9643f69077104e88347edc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.896770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:36.918447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d13ebf2e9643f69077104e88347edc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:36.936452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92162dc-1745-4d4b-9222-f52c12f23cb7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:36.954785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:36.956618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:36.958545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:36.961436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] PATH_INFO: `/v3/users/cb19d221e88d4a0f92a747922f26262e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:36.966083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb19d221e88d4a0f92a747922f26262e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:36.969328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:36.974747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 865/1750] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:36 2022] DELETE /identity/v3/users/47d13ebf2e9643f69077104e88347edc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:36.974747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:36.979421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.132954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb19d221e88d4a0f92a747922f26262e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:37.174078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb19d221e88d4a0f92a747922f26262e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:37.180637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb19d221e88d4a0f92a747922f26262e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:37.203356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb19d221e88d4a0f92a747922f26262e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:37.204042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb19d221e88d4a0f92a747922f26262e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:37.241701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fbe6a-f137-4d1b-a923-5152acd55f4c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:37.255467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:37.266318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 886/1751] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:36 2022] DELETE /identity/v3/users/cb19d221e88d4a0f92a747922f26262e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:37.269964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:37.270295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:37.270628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:37.276972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.279093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:37.297262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.456445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:37.462455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:37.486531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 866/1752] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:37.487489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:37.495304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.499141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc51e4-256e-4894-bee8-a4fcd330dab6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:37.511625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:37.513612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:37.514332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:37.515443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:37.517861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:37.519457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:37.527128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ba687-7ce2-4e63-aa3c-97c2a5605cb4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:37.562375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 887/1753] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:37.565388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:37.566404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:37.567463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:37.619399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:37.619657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f8f76-d8a0-4ae4-b9f6-cd9cbe5c7cb1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:37.622731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.631398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:37.658331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 888/1754] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:37.658331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:37.662005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.705561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:37.780898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:37.780898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:37.780898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:37.780898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:37.794494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:37.985286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e2a2b-a7a1-4ccc-ade8-e55eb6058567 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:37.998467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:37.999321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:37.999714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.000108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.005279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:38.011107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.017570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.030027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.037227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.047106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 867/1755] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:38.050960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:38.069430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 889/1756] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:38.075856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:38.082474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:38.102523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77233aa-de61-428f-ba34-fda448ce68b6 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:38.116975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ccf3-1417-485f-8d3a-2473a3c20308 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:38.122788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:38.123688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.124912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.125329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.126173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.129833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.134961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:38.139320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.139819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.140172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.184153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.191875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.245900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 890/1757] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:38.252727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 868/1758] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:38 2022] POST /identity/v3/projects => generated 372 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:38.254014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:38.273018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45e120-5dae-46a4-922b-1123d7f7f3e3 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:38.492553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:38.494456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.494809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.495634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.500075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.505892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.597547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 891/1759] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:38 2022] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:19:38.600709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:38.634773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27493ca-5bff-49d1-ad90-b7c4abf289c9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:38.650128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:38.650878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.651499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.651988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.652847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.654765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.692480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:38.693214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 869/1760] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:38 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:38.715172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01b253-6c3e-48ad-9c96-e392f31c4edf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:38.734025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e064ce-9a3c-4649-8260-09d9727c2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:38.735434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e064ce-9a3c-4649-8260-09d9727c2a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.736582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e064ce-9a3c-4649-8260-09d9727c2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.739049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e064ce-9a3c-4649-8260-09d9727c2a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.740263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e064ce-9a3c-4649-8260-09d9727c2a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.746786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e064ce-9a3c-4649-8260-09d9727c2a55 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.784530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 892/1761] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:38 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:38.791353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:38.817349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a09f28-fe82-4a5c-8882-e8a01fbfc0a3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:38.840625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:38.842262 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.842590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.842880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] PATH_INFO: `/v3/projects/120be2c4a90647c28d97db19de5ab412/users/56965452a7ad42e580239d11bf46944f/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:38.923189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120be2c4a90647c28d97db19de5ab412, user_id=56965452a7ad42e580239d11bf46944f, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:38.928341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:38.973710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 870/1762] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:38 2022] PUT /identity/v3/projects/120be2c4a90647c28d97db19de5ab412/users/56965452a7ad42e580239d11bf46944f/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:38.988703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:38.989698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:38.990176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:39.186009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] MFA Rules not processed for user `56965452a7ad42e580239d11bf46944f`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:39.194465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:39.528765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:39.530741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:39.582850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 893/1763] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:39.597253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:39.634726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:39.807952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2269-85f8-4610-92fa-dd209923b150 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:39.819049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:39.819951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:39.820363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:39.820629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] PATH_INFO: `/v3/projects/50cafff8792d437f953f76b1a9e2f6d4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:39.829091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cafff8792d437f953f76b1a9e2f6d4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:39.834482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:39.856503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ce36-a34f-4a8e-8854-38bb75fcba6d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:39.889576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:39.890850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:39.892753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:39.893158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:39.897051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:39.897861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:39.907139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:40.053249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 894/1764] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:39 2022] POST /identity/v3/projects => generated 374 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:40.055975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:40.064137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:40.091631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cafff8792d437f953f76b1a9e2f6d4', 'request_id': 'req-840b024f-fd34-44a2-946a-9b75b044141b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.140657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cafff8792d437f953f76b1a9e2f6d4', 'request_id': 'req-840b024f-fd34-44a2-946a-9b75b044141b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.170411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cafff8792d437f953f76b1a9e2f6d4', 'request_id': 'req-840b024f-fd34-44a2-946a-9b75b044141b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.265526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] The token cache is being invalidate because project 50cafff8792d437f953f76b1a9e2f6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:40.272180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.279119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.292241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 871/1765] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:39 2022] DELETE /identity/v3/projects/50cafff8792d437f953f76b1a9e2f6d4 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:40.296885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:40.302877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:40.449818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb95f-2a1c-49e3-a653-59b63a1bf92f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:40.485912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:40.487236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:40.487496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:40.487872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] PATH_INFO: `/v3/projects/93616753e98e443e99323b1ffc17584f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:40.490449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=93616753e98e443e99323b1ffc17584f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:40.495328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:40.512016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b024f-fd34-44a2-946a-9b75b044141b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:40.534272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bec0b-766e-47f3-8120-428406d25be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:40.535099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bec0b-766e-47f3-8120-428406d25be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:40.535700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bec0b-766e-47f3-8120-428406d25be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:40.536248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bec0b-766e-47f3-8120-428406d25be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:40.537494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bec0b-766e-47f3-8120-428406d25be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:40.554977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bec0b-766e-47f3-8120-428406d25be0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:40.677444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 872/1766] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:40 2022] POST /identity/v3/users => generated 294 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:40.711893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:40.712819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:40.713752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:40.718210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93616753e98e443e99323b1ffc17584f', 'request_id': 'req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.761177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93616753e98e443e99323b1ffc17584f', 'request_id': 'req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.775049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93616753e98e443e99323b1ffc17584f', 'request_id': 'req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.798239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] The token cache is being invalidate because project 93616753e98e443e99323b1ffc17584f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:40.799161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.800038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:40.803222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 895/1767] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:40 2022] DELETE /identity/v3/projects/93616753e98e443e99323b1ffc17584f => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:40.805140 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:40.806767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:40.874170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:40.882766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:40.931138 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:41.073818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf48a8-352f-4e0a-8c7c-51fa51e56dab admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:41.095139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:41.096170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:41.096346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:41.096613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] PATH_INFO: `/v3/projects/5d0d2cec89574402adff587f5310c089` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:41.109700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0d2cec89574402adff587f5310c089)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:41.112275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 873/1768] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:41.113608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:41.114559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:41.115247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:41.162157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd6cf8-7133-4af5-9389-5d6fd2f06967 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:41.178331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:41.179429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:41.180303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:41.180889 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:41.182129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:41.185141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:41.225195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 874/1769] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:41 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:41.227073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:41.234575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:41.280734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0d2cec89574402adff587f5310c089', 'request_id': 'req-8135d5b4-5073-4180-be66-642eb5f96c97'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.292019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376bcf3-b23e-4890-b264-98065bb46711 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:41.301860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0d2cec89574402adff587f5310c089', 'request_id': 'req-8135d5b4-5073-4180-be66-642eb5f96c97'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.317094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0d2cec89574402adff587f5310c089', 'request_id': 'req-8135d5b4-5073-4180-be66-642eb5f96c97'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.340874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:41.365452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] The token cache is being invalidate because project 5d0d2cec89574402adff587f5310c089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:41.365759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.367565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8135d5b4-5073-4180-be66-642eb5f96c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.371615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 896/1770] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:40 2022] DELETE /identity/v3/projects/5d0d2cec89574402adff587f5310c089 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:41.377359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:41.377359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:41.377359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:41.459127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:41.466368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:41.531501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:41.532682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:41.533160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:41.533589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] PATH_INFO: `/v3/users/37ec00d05e714940a3592ca56e75a062` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:41.537977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ec00d05e714940a3592ca56e75a062)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:41.553762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:41.652981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 897/1771] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:41.653926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:41.655551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:41.692750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4919852-9442-4a1c-93a5-46aeb0dcb27b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:41.697694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ec00d05e714940a3592ca56e75a062'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.699597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ec00d05e714940a3592ca56e75a062'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.700997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ec00d05e714940a3592ca56e75a062'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.711778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:41.712614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:41.712910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:41.713227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] PATH_INFO: `/v3/projects/7a0048e61ed349a5b24c65dab0a7a1ae/users/0f3a4fc0e4b340a8bcf16f54c9774db3/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:41.727668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ec00d05e714940a3592ca56e75a062'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.740626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ec00d05e714940a3592ca56e75a062'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:41.771730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0048e61ed349a5b24c65dab0a7a1ae, user_id=0f3a4fc0e4b340a8bcf16f54c9774db3, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:41.775148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:41.799675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 875/1772] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:41 2022] DELETE /identity/v3/users/37ec00d05e714940a3592ca56e75a062 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:41.801149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:41.805994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:41.820464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 898/1773] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:41 2022] PUT /identity/v3/projects/7a0048e61ed349a5b24c65dab0a7a1ae/users/0f3a4fc0e4b340a8bcf16f54c9774db3/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:41.821922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:41.829680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:41.927844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:42.017206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6197b-8444-4bf6-81e9-381a66444533 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.110538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276dfdb-314b-4447-b3b8-391eee5b3848 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.128603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.130237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.130722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.131211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.134872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:42.136660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.138874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:42.168634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 899/1774] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:42.184955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:42.186676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:42.189705 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:42.229378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a180-ed0c-49f0-9a2a-b7206529b44f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.233918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.236244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.237196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.238289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] PATH_INFO: `/v3/users/26f33d48b0ec4aa2a104110e79bb9f87` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.241678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.241895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f33d48b0ec4aa2a104110e79bb9f87)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.242711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.244860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:42.245785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.246531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.247027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.250499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:42.287240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 900/1775] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:42 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:42.287240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:42.323556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56bfd7-306a-45a6-aa42-41d224a485a0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.352464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.355233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.356250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.357847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.359605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.373835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:42.438822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f33d48b0ec4aa2a104110e79bb9f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.440850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f33d48b0ec4aa2a104110e79bb9f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.441581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f33d48b0ec4aa2a104110e79bb9f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.498944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f33d48b0ec4aa2a104110e79bb9f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.514529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-167f0686-50bd-49c7-ac8a-3d78d65677f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f33d48b0ec4aa2a104110e79bb9f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.528188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 901/1776] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:42 2022] POST /identity/v3/projects => generated 370 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:42.535417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 876/1777] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:41 2022] DELETE /identity/v3/users/26f33d48b0ec4aa2a104110e79bb9f87 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:42.537532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.538120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.538607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.549728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:42.553370 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:42.566065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] MFA Rules not processed for user `f99afdfcdd32429f88a03a06dd71453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:42.568031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:42.659163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 877/1778] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:42.661364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:42.678147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:42.759707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce904a-a9de-4d7e-a0a6-8f78edde739b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.845325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62bad0-ec2d-4022-b74f-f6d06fa2aeed None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.851647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.852992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.853702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.854240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] PATH_INFO: `/v3/users/339d760ac9634c8e89227c11335415fc` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.856246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339d760ac9634c8e89227c11335415fc)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.859041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:42.867447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:42.962486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.963423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.963706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.963981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] PATH_INFO: `/v3/projects/7a0048e61ed349a5b24c65dab0a7a1ae/users/0f3a4fc0e4b340a8bcf16f54c9774db3/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.965935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339d760ac9634c8e89227c11335415fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.967130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339d760ac9634c8e89227c11335415fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.968197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0048e61ed349a5b24c65dab0a7a1ae, user_id=0f3a4fc0e4b340a8bcf16f54c9774db3, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.969462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339d760ac9634c8e89227c11335415fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:42.985217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:43.049919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339d760ac9634c8e89227c11335415fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:43.061495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 902/1779] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:42 2022] PUT /identity/v3/projects/7a0048e61ed349a5b24c65dab0a7a1ae/users/0f3a4fc0e4b340a8bcf16f54c9774db3/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:43.062884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:43.066438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:43.069896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-556f7a51-21b0-4c2a-bb36-f6671cc52e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339d760ac9634c8e89227c11335415fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:43.098609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 878/1780] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:42 2022] DELETE /identity/v3/users/339d760ac9634c8e89227c11335415fc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:43.100073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03602-7c57-43f4-8a38-811f518873e8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.100493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03602-7c57-43f4-8a38-811f518873e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.100649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03602-7c57-43f4-8a38-811f518873e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.176178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dcd03602-7c57-43f4-8a38-811f518873e8 None None] MFA Rules not processed for user `113a0a0591384937ae2408f468be8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:43.177623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dcd03602-7c57-43f4-8a38-811f518873e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:43.232514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:43.327637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15658ec2-5766-4635-977f-b1bec92c18e0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:43.424772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 879/1781] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:43.429777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a8359-084f-4671-b524-909d70050fe2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.431809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a8359-084f-4671-b524-909d70050fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.432147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a8359-084f-4671-b524-909d70050fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.519662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-858a8359-084f-4671-b524-909d70050fe2 None None] MFA Rules not processed for user `0f3a4fc0e4b340a8bcf16f54c9774db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:43.535719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-858a8359-084f-4671-b524-909d70050fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:43.549612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592ff6d-21da-4a51-94a0-d8d74c65f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:43.555513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ff6d-21da-4a51-94a0-d8d74c65f0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.555921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ff6d-21da-4a51-94a0-d8d74c65f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.556105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592ff6d-21da-4a51-94a0-d8d74c65f0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.556851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592ff6d-21da-4a51-94a0-d8d74c65f0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:43.570510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592ff6d-21da-4a51-94a0-d8d74c65f0b0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:43.671926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 903/1782] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:43 2022] POST /identity/v3/users => generated 286 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:43.689738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863483c6-ceb7-4f6c-ae63-efcdaf3b3af6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.690113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863483c6-ceb7-4f6c-ae63-efcdaf3b3af6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.690395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863483c6-ceb7-4f6c-ae63-efcdaf3b3af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.744768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-863483c6-ceb7-4f6c-ae63-efcdaf3b3af6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:43.746543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-863483c6-ceb7-4f6c-ae63-efcdaf3b3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:43.764184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 904/1783] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:43.766642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a358ff-9585-46f9-9d92-789d215ae395 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.767163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a358ff-9585-46f9-9d92-789d215ae395 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.767761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a358ff-9585-46f9-9d92-789d215ae395 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.773194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 905/1784] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:19:43 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:43.775238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a358ff-9585-46f9-9d92-789d215ae395 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:43.780118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f5a358ff-9585-46f9-9d92-789d215ae395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:43.846702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a358ff-9585-46f9-9d92-789d215ae395 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:43.848274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 880/1785] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:43.850097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a8359-084f-4671-b524-909d70050fe2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:43.860573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:43.861923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.862399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.862900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] PATH_INFO: `/v3/projects/65b52232dc3c47cc9bc9a7b6261f5297` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.865733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b52232dc3c47cc9bc9a7b6261f5297)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:43.868345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:43.888850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a8359-084f-4671-b524-909d70050fe2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:43.893702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:43.895175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:43.895474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:43.895756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:43.896580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:43.903238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:43.933810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 881/1786] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:43 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:43.939473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:43.942857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:43.963052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:44.006541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b52232dc3c47cc9bc9a7b6261f5297', 'request_id': 'req-e94760cb-7f3e-416d-852d-2a69d841fcd1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:44.023335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b52232dc3c47cc9bc9a7b6261f5297', 'request_id': 'req-e94760cb-7f3e-416d-852d-2a69d841fcd1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:44.037997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b52232dc3c47cc9bc9a7b6261f5297', 'request_id': 'req-e94760cb-7f3e-416d-852d-2a69d841fcd1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:44.080674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] The token cache is being invalidate because project 65b52232dc3c47cc9bc9a7b6261f5297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:44.081098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:44.082520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:44.088272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 906/1787] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:43 2022] DELETE /identity/v3/projects/65b52232dc3c47cc9bc9a7b6261f5297 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:44.091605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:44.094616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:44.124554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24290df-483d-4edd-b36a-acc910d7b821 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:44.256378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:44.290962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:44.292861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.293310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94760cb-7f3e-416d-852d-2a69d841fcd1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:44.293679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.295066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:44.299285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:44.302777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:44.303603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.304521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.306907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:44.311948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:44.486509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:44.494927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:44.496490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:44.503990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa17a-b0da-475b-98c2-680da9aefb57 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:44.525586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 907/1788] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:44.546877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 882/1789] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:44.547051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6d3a-2f10-4b29-adaf-8e3d3adc772a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.547816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:44.553884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:44.559733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6d3a-2f10-4b29-adaf-8e3d3adc772a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.561459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6d3a-2f10-4b29-adaf-8e3d3adc772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:44.584482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045f58-52bf-4555-8df3-89da43ef9aee service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:44.595224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc99495-0826-4305-a5e2-f65749b6f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:44.597357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc99495-0826-4305-a5e2-f65749b6f584 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.597611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc99495-0826-4305-a5e2-f65749b6f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.599326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc99495-0826-4305-a5e2-f65749b6f584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:44.600004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc99495-0826-4305-a5e2-f65749b6f584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:44.613678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc99495-0826-4305-a5e2-f65749b6f584 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:44.638744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 883/1790] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:44 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:44.644345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.644345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.644345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:44.676398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d99d6d3a-2f10-4b29-adaf-8e3d3adc772a None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:44.689520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d99d6d3a-2f10-4b29-adaf-8e3d3adc772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:44.708157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:44.708546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:44.718215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 884/1791] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:44.731587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:44.768482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aee37-886a-4da0-93f7-96d70517d41a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:44.773629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:44.774534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.774818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.775096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] PATH_INFO: `/v3/projects/a6be0c73f5914842aef67b413ff2fdb8/users/1c960c78cdcc47f58bd6f8adab392a11/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:44.805679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6be0c73f5914842aef67b413ff2fdb8, user_id=1c960c78cdcc47f58bd6f8adab392a11, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:44.812326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:44.848323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 885/1792] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:44 2022] PUT /identity/v3/projects/a6be0c73f5914842aef67b413ff2fdb8/users/1c960c78cdcc47f58bd6f8adab392a11/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:44.848323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:44.940265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:44.984574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 908/1793] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:44.987237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95cb1-72fc-41ba-a5a3-3d017daae055 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:44.987579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95cb1-72fc-41ba-a5a3-3d017daae055 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:44.988176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95cb1-72fc-41ba-a5a3-3d017daae055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.021637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf94ff-77d2-4310-9b5e-78b54219578d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:45.034787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:45.035904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:45.036380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:45.036824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.045956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:45.073882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6ae95cb1-72fc-41ba-a5a3-3d017daae055 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:45.076892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ae95cb1-72fc-41ba-a5a3-3d017daae055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:45.302285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 909/1794] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:45.305530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:45.307513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37faa7e-d944-48ab-8acf-f1dd22c2da50 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:45.308475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:45.308975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:45.309497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.362099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 886/1795] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:45.381609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] MFA Rules not processed for user `1c960c78cdcc47f58bd6f8adab392a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:45.383224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:45.388400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73446b4-b1f4-4dba-a29c-d0ebaf27f47d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:45.388736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73446b4-b1f4-4dba-a29c-d0ebaf27f47d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:45.388963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73446b4-b1f4-4dba-a29c-d0ebaf27f47d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.395453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 887/1796] 10.222.0.113 () {54 vars in 917 bytes} [Mon Jul 25 19:19:45 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:45.396374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73446b4-b1f4-4dba-a29c-d0ebaf27f47d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:45.438845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:45.470074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73446b4-b1f4-4dba-a29c-d0ebaf27f47d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:45.488606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:45.489668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:45.491689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:45.492118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.494194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:45.495020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:45.499501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d3906-376c-485b-9da0-bab8a3dc8ce2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:45.536561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 888/1797] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:45.536561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:45.536561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:45.536561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.606878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:45.614278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:45.618016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 910/1798] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:45.619817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:45.663919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe974-7a15-417b-a6d7-b72b1b2c250f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:45.698139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:45.704373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:45.705622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:45.707066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:45.712213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:45.720757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:45.828900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 911/1799] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:45 2022] POST /identity/v3/projects => generated 382 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:45.839714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:45.845384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 889/1800] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:45.847407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:45.850016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:45.883404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a430d-3c5c-4616-8c7a-4ee348222969 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:46.002876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a351-0fd4-48c8-af46-85e0ab30c1ff admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:46.020008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:46.020768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:46.021058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:46.021367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:46.022167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:46.024443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:46.084679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 912/1801] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:45 2022] POST /identity/v3/projects => generated 368 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:46.084928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:46.119890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:46.126880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:46.127312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:46.127689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] PATH_INFO: `/v3/projects/2c0f27b8217141448c3e830e519118e2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:46.131884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0f27b8217141448c3e830e519118e2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:46.141689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:46.199552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:46.276066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c40bb-c86c-4237-a39c-cb4f7d30e585 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:46.285923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0f27b8217141448c3e830e519118e2', 'request_id': 'req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.304595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0f27b8217141448c3e830e519118e2', 'request_id': 'req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.333318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0f27b8217141448c3e830e519118e2', 'request_id': 'req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.338645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:46.404861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] The token cache is being invalidate because project 2c0f27b8217141448c3e830e519118e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:46.406586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.409994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.413095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 890/1802] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:45 2022] DELETE /identity/v3/projects/2c0f27b8217141448c3e830e519118e2 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:46.414677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:46.419918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:46.432886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:46.434054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:46.434522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:46.435039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:46.435930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:46.438223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:46.461209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b4c1-8e2c-420d-8a31-5b0b4745b6b2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:46.476430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:46.477749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:46.478122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:46.478468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] PATH_INFO: `/v3/projects/9f4f42e87c8a4ae283ceb8b6ee2b3268` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:46.479882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4f42e87c8a4ae283ceb8b6ee2b3268)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:46.481035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 913/1803] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:46 2022] POST /identity/v3/users => generated 292 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:46.483265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:46.483649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:46.486652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:46.613568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4f42e87c8a4ae283ceb8b6ee2b3268', 'request_id': 'req-b5f2ad5a-465f-485d-b21a-2f773495dd56'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.627355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4f42e87c8a4ae283ceb8b6ee2b3268', 'request_id': 'req-b5f2ad5a-465f-485d-b21a-2f773495dd56'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.637024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4f42e87c8a4ae283ceb8b6ee2b3268', 'request_id': 'req-b5f2ad5a-465f-485d-b21a-2f773495dd56'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.642093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b5b0e-eb14-4a76-a03a-36fef0f9d667 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:46.668027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] The token cache is being invalidate because project 9f4f42e87c8a4ae283ceb8b6ee2b3268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:46.668342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.669035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:46.674502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 891/1804] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:46 2022] DELETE /identity/v3/projects/9f4f42e87c8a4ae283ceb8b6ee2b3268 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:46.674502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:46.674502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:46.796440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:46.797815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:46.798201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:46.798724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:46.801876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:46.834234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:46.837687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:46.881249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 914/1805] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:46.882808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:46.890613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:46.976852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2ad5a-465f-485d-b21a-2f773495dd56 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.002013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.004470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.009635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.009935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.010803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:47.012822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:47.106935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 892/1806] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:46 2022] POST /identity/v3/users => generated 291 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:47.110814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:47.118113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.138561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e948c5-dfec-474a-8863-84ccf4675626 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.155133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d2a62-425c-4b36-9176-62df090c3ae3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.163959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.164917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.166635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.167065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.170400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.171306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.171689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.173887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.174393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] PATH_INFO: `/v3/users/8243cf2096bb461081277ecc5748b19e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.177532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8243cf2096bb461081277ecc5748b19e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:47.182378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:47.230054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:47.231867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:47.248731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=15,keystone:SELECT=80,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:47.262047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:47.279753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 915/1807] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:47.281742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:47.286397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.333885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11b63b-634c-47c6-a70f-fa423d2c95c4 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.348071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0ead1-f5b5-4202-9c77-ef657bceef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.349062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0ead1-f5b5-4202-9c77-ef657bceef1b admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.349523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0ead1-f5b5-4202-9c77-ef657bceef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.349897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0ead1-f5b5-4202-9c77-ef657bceef1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.350795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0ead1-f5b5-4202-9c77-ef657bceef1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:47.353575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0ead1-f5b5-4202-9c77-ef657bceef1b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:47.358957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8243cf2096bb461081277ecc5748b19e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:47.360641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8243cf2096bb461081277ecc5748b19e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:47.361692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8243cf2096bb461081277ecc5748b19e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:47.377557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 916/1808] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:47 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:47.377557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.377557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.377557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.398244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8243cf2096bb461081277ecc5748b19e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:47.431271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8243cf2096bb461081277ecc5748b19e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:47.444069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:47.445111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.478848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 893/1809] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:47 2022] DELETE /identity/v3/users/8243cf2096bb461081277ecc5748b19e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:47.484850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:47.491107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.521220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 917/1810] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:47.522697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:47.526590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.603026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dce4c-813f-4a5d-94b2-d82303dbb7a8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.734509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187d176-7b76-423a-b211-00cd01f53082 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.762542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49f572-7066-4913-9ccc-31e20bb6f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.766011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f572-7066-4913-9ccc-31e20bb6f0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.770068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f572-7066-4913-9ccc-31e20bb6f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.775353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49f572-7066-4913-9ccc-31e20bb6f0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.782527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f572-7066-4913-9ccc-31e20bb6f0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:47.789524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49f572-7066-4913-9ccc-31e20bb6f0d2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:47.828078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 894/1811] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:47 2022] GET /identity/v3/roles => generated 1427 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:47.831289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.831730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.832120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.902093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:47.906761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:47.938989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.939555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 895/1812] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:47.939658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.939658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.939658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:47.940488 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:47.943650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:47.948799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:47.970373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa0305-8acd-4181-96f3-b6f636be87a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:47.989340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:47.993219 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:47.993527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:47.993829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] PATH_INFO: `/v3/projects/330ab0f9024b4893bb43e58f74c7ce4c/users/4789030c63054105b2ca824ae06dbc64/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.007139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 918/1813] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:47 2022] GET /identity/v3/roles => generated 1427 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:48.012638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.047047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330ab0f9024b4893bb43e58f74c7ce4c, user_id=4789030c63054105b2ca824ae06dbc64, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.049877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.051197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519566fb-25a9-4fd9-990f-2dfc73c33244 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:48.071186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:48.074592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.075739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.076726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.078385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:48.078743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.096615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 896/1814] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:47 2022] PUT /identity/v3/projects/330ab0f9024b4893bb43e58f74c7ce4c/users/4789030c63054105b2ca824ae06dbc64/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:48.096615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.097269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.163478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 919/1815] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:48.164754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.196606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1582f1-6c4b-4b98-97c4-357eecc28fde admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:48.343330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc476031-5eb6-4f01-a23c-6b5a81a75457 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:48.366443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:48.367474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.367758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.368167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] PATH_INFO: `/v3/projects/6532e8421cf04b908e7b89b09f447ddb/users/0c491043276b4d3386cd0ead71d6b9cd/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.376536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:48.378072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.378072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.378072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.378687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.381574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:48.392433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.427679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6532e8421cf04b908e7b89b09f447ddb, user_id=0c491043276b4d3386cd0ead71d6b9cd, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.445851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.449197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 920/1816] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:48 2022] GET /identity/v3/roles => generated 1427 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:48.450119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.470055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb371d3-fd49-414d-82e7-fbbad3d2bb9d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:48.482541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771875-003d-41fc-bf93-47dd46fb75d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:48.483602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771875-003d-41fc-bf93-47dd46fb75d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.484068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771875-003d-41fc-bf93-47dd46fb75d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.484524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771875-003d-41fc-bf93-47dd46fb75d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.486146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771875-003d-41fc-bf93-47dd46fb75d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.490037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771875-003d-41fc-bf93-47dd46fb75d3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.552707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 897/1817] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:48 2022] PUT /identity/v3/projects/6532e8421cf04b908e7b89b09f447ddb/users/0c491043276b4d3386cd0ead71d6b9cd/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:48.557007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.563114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 921/1818] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:48 2022] POST /identity/v3/projects => generated 366 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:48.565810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.566152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.567142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.627090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] MFA Rules not processed for user `0c491043276b4d3386cd0ead71d6b9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:48.628915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:48.672612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:48.748176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 922/1819] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:48.749630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.751575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585b81-e10e-4463-9812-794d5d5c8c0b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:48.872846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:48.874190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.874552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.874905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] PATH_INFO: `/v3/projects/330ab0f9024b4893bb43e58f74c7ce4c/users/4789030c63054105b2ca824ae06dbc64/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.875160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a1112-2e46-4bb0-a895-c69de3cf0c59 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:48.877846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=330ab0f9024b4893bb43e58f74c7ce4c, user_id=4789030c63054105b2ca824ae06dbc64, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.884746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.885990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8aa80-ff8f-4d3c-9bfd-1c1e49572a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:48.887320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8aa80-ff8f-4d3c-9bfd-1c1e49572a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.888038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8aa80-ff8f-4d3c-9bfd-1c1e49572a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.888392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8aa80-ff8f-4d3c-9bfd-1c1e49572a10 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:48.889329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8aa80-ff8f-4d3c-9bfd-1c1e49572a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:48.892450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8aa80-ff8f-4d3c-9bfd-1c1e49572a10 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:48.914061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 898/1820] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:48 2022] PUT /identity/v3/projects/330ab0f9024b4893bb43e58f74c7ce4c/users/4789030c63054105b2ca824ae06dbc64/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:48.918891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:48.955207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 923/1821] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:48 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:48.967161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:48.967616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:48.968178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.023602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] MFA Rules not processed for user `4789030c63054105b2ca824ae06dbc64`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:49.026148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.028490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee37e48-4bef-41cd-aa80-16d889cb9b9f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.035944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.036650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.036952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.037328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.038498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.042206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.106891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 899/1822] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:48 2022] POST /identity/v3/projects => generated 384 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:49.106891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.106891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.118573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:49.132262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 924/1823] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:49.132262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.150130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47024170-b391-4665-9d03-2eae0b5408d1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.206142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefc08-030a-4c1a-b8aa-6c7ab633a314 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.209688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:49.212439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.213362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.213862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.213990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] PATH_INFO: `/v3/projects/badaf6569bd842ecaaed8325c94c983d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.215186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=badaf6569bd842ecaaed8325c94c983d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.217142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.231269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.232065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.232416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.233095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.233891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.235777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.247551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 925/1824] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:49.249061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.260530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae249a-70ec-45c8-a3df-ddd3b4aa22a7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.275996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badaf6569bd842ecaaed8325c94c983d', 'request_id': 'req-f60901f4-99a2-4ed2-9496-529ff40feffd'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:49.291254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badaf6569bd842ecaaed8325c94c983d', 'request_id': 'req-f60901f4-99a2-4ed2-9496-529ff40feffd'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:49.299093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badaf6569bd842ecaaed8325c94c983d', 'request_id': 'req-f60901f4-99a2-4ed2-9496-529ff40feffd'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:49.315330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] The token cache is being invalidate because project badaf6569bd842ecaaed8325c94c983d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:49.315743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:49.318909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:49.325234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 900/1825] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:49 2022] DELETE /identity/v3/projects/badaf6569bd842ecaaed8325c94c983d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:49.326941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.331789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.411147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.412252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.412708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.413242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.425425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.429256 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.463592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60901f4-99a2-4ed2-9496-529ff40feffd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.470345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.471319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.471790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.472424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.475164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.512723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 926/1826] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:49 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:49.513821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.522298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.540219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494380-1c0c-4d24-b3d6-6bccf1679652 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.547379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5abe0-4fb2-444d-844c-d983b287d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.548716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5abe0-4fb2-444d-844c-d983b287d65c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.549551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5abe0-4fb2-444d-844c-d983b287d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.550192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5abe0-4fb2-444d-844c-d983b287d65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.552113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5abe0-4fb2-444d-844c-d983b287d65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.555678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5abe0-4fb2-444d-844c-d983b287d65c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.573924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 927/1827] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:49.575338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.575632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.575968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.591193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:49.611304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.614002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.618949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:49.629553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.634247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 901/1828] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:49.635194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.636757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.641287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 928/1829] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:49.643491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.651781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1772aad-2859-4c89-97ee-0b2ee4cea964 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.657330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a5c11-9644-425e-961b-d623b779d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.657572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e129c2c-2bb5-46d1-bf17-a651a3ea2e53 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.658028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a5c11-9644-425e-961b-d623b779d323 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.658320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a5c11-9644-425e-961b-d623b779d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.658603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a5c11-9644-425e-961b-d623b779d323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.659642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a5c11-9644-425e-961b-d623b779d323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.662205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a5c11-9644-425e-961b-d623b779d323 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.664478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.665468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.665753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.666032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] PATH_INFO: `/v3/projects/4ad78605c1434d6cbc1cdf161b8f9b96/users/cb95d50620cf4e6ebf47fcd421cc6037/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.675131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 902/1830] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:49.676607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.677150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.678953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.698673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad78605c1434d6cbc1cdf161b8f9b96, user_id=cb95d50620cf4e6ebf47fcd421cc6037, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.701701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.705555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:49.707768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.723133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 903/1831] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:49.724142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 929/1832] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:49 2022] PUT /identity/v3/projects/4ad78605c1434d6cbc1cdf161b8f9b96/users/cb95d50620cf4e6ebf47fcd421cc6037/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:49.727181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.727857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.732488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.744855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a92112-2ab4-494b-8743-9a4be3dfd517 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.818935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.819967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.820391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.820544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] PATH_INFO: `/v3/projects/2ff466300812440bac338d104e1a536b/users/5389ff0736c7428582d1f28a7e958991/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.826988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37b86-8363-4905-a357-cd4d1635f7c4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.832631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.833392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.833699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.833972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.836075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:49.837374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff466300812440bac338d104e1a536b, user_id=5389ff0736c7428582d1f28a7e958991, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.840290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.862633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 904/1833] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:49 2022] PUT /identity/v3/projects/2ff466300812440bac338d104e1a536b/users/5389ff0736c7428582d1f28a7e958991/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:49.863826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:49.897237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:49.949076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.949076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49215ca4-cf60-4b14-91e1-0a5f3e12e5d2 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.959385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 930/1834] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:49.961086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.961968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.962345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.970103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d914601-1eea-48d9-a76b-c4df6065ab07 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:49.975607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:49.976209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:49.976986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:49.976986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:49.977707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:19:49.978020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:49.980402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:49.997555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 905/1835] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:19:50.000558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.002546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] MFA Rules not processed for user `cb95d50620cf4e6ebf47fcd421cc6037`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:50.003817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:50.027244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a2dd8-333f-42b1-8e46-b68ad18ac6a3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.032032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.032741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.033026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.033335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.034088 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.036020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.047409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 906/1836] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:49 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:50.050246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.065249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04302a5-2176-4e3d-9070-73b4881b660d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.071462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.072355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.072906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.073462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.074744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.078214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.103702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 931/1837] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:50.104417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.122060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 907/1838] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:50 2022] POST /identity/v3/projects => generated 368 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:50.123423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.124249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee2486-d4c5-49f6-8d17-5f34241dd964 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.151140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:50.214241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794158-85af-47e2-8807-9e6dbc023341 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.215171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.216322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.216322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.216635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] PATH_INFO: `/v3/projects/2ff466300812440bac338d104e1a536b/users/5389ff0736c7428582d1f28a7e958991/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.218850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff466300812440bac338d104e1a536b, user_id=5389ff0736c7428582d1f28a7e958991, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.220691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de4732-0b29-4941-adcf-27259934ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.221521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4732-0b29-4941-adcf-27259934ad37 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.222201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.222332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4732-0b29-4941-adcf-27259934ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.222440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4732-0b29-4941-adcf-27259934ad37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.223324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de4732-0b29-4941-adcf-27259934ad37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.225684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de4732-0b29-4941-adcf-27259934ad37 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.236006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 932/1839] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:50 2022] PUT /identity/v3/projects/2ff466300812440bac338d104e1a536b/users/5389ff0736c7428582d1f28a7e958991/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:50.236852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.267249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 908/1840] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:50 2022] POST /identity/v3/projects => generated 366 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:50.268910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53055-973a-464d-804d-66a51589d15b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.269314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53055-973a-464d-804d-66a51589d15b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.269751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc53055-973a-464d-804d-66a51589d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.307576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6bc53055-973a-464d-804d-66a51589d15b None None] MFA Rules not processed for user `5389ff0736c7428582d1f28a7e958991`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:50.308823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6bc53055-973a-464d-804d-66a51589d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:50.318353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4dce-62f1-4b14-b582-17d202062345 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.334947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:50.402190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 909/1841] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:50.403060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53055-973a-464d-804d-66a51589d15b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.416884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.417848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.418397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.418668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.419407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.421399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.457505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 933/1842] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:50 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:50.458466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.492549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc53055-973a-464d-804d-66a51589d15b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.497690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.498384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.498673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.498954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.499967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.502209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.521473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0b0aa-a477-466d-b194-f13e5b6065e2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.525953 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.526761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.527020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.527291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.533606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 910/1843] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:50 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:50.535321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.541883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.543943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.548039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dca416-897f-45fe-8656-2d716c31ffbe admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.554205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.554912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.555202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.555487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.556362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.558820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.564363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 934/1844] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:50.565424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.572727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 911/1845] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:50 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:50.578655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.582031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a1b9-3432-4275-9678-a5270a43ef66 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.594734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.595828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.596107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.596386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.597864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.600490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.604620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:50.611580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac636e6-f097-4779-9775-5830a1db7c6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.627800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 935/1846] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:50 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:50.629417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.644963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50940b3-0976-49ab-b2f9-6bf60db23789 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.653419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.653419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.653419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.653419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.658530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.664459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.666053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.666800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.669025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.671246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] PATH_INFO: `/v3/projects/0ce024c54ed748e8a8a1c8c2a5cc7b2b/users/8cf1d668bb904c448f5d1c235903868f/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.694966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 912/1847] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:50 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:50.695690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.714033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce024c54ed748e8a8a1c8c2a5cc7b2b, user_id=8cf1d668bb904c448f5d1c235903868f, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.728164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.731639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26577-5e3d-4674-905a-b0ca3d90fa38 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.740377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.742649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.742931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.743322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] PATH_INFO: `/v3/projects/1f2a3a85806c4d9499c12d2bc4279d68/users/9e46f723b186463db955aa5752cf3ec6/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.760594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 936/1848] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:50 2022] PUT /identity/v3/projects/0ce024c54ed748e8a8a1c8c2a5cc7b2b/users/8cf1d668bb904c448f5d1c235903868f/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:50.762963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.784971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2a3a85806c4d9499c12d2bc4279d68, user_id=9e46f723b186463db955aa5752cf3ec6, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.793217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:50.841430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 913/1849] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:50 2022] PUT /identity/v3/projects/1f2a3a85806c4d9499c12d2bc4279d68/users/9e46f723b186463db955aa5752cf3ec6/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:50.841430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:50.921553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef646-b31e-4e84-9e1d-9aa70b5b2aa1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.976896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627d66-ac83-4f84-994b-477ca98794f5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:50.983116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972f06-fd0e-4a25-ae13-de80f57848f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:50.983913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972f06-fd0e-4a25-ae13-de80f57848f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:50.984277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972f06-fd0e-4a25-ae13-de80f57848f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:50.984678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972f06-fd0e-4a25-ae13-de80f57848f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:50.985791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18972f06-fd0e-4a25-ae13-de80f57848f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:50.988339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18972f06-fd0e-4a25-ae13-de80f57848f8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:51.006495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 914/1850] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:50 2022] GET /identity/v3/roles => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:19:51.009155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.010219 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.011571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.034104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:51.072669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] MFA Rules not processed for user `9e46f723b186463db955aa5752cf3ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:51.074930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:51.138532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:51.139238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.139521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.139801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.148660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:51.195851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 915/1851] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:51.196837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:51.211833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12efaf-0489-4379-9b91-c7d5ab8786f9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:51.225164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:51.225164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.225164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.225554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] PATH_INFO: `/v3/projects/0ce024c54ed748e8a8a1c8c2a5cc7b2b/users/8cf1d668bb904c448f5d1c235903868f/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.228139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce024c54ed748e8a8a1c8c2a5cc7b2b, user_id=8cf1d668bb904c448f5d1c235903868f, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:51.247794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:51.265173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 916/1852] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:51 2022] PUT /identity/v3/projects/0ce024c54ed748e8a8a1c8c2a5cc7b2b/users/8cf1d668bb904c448f5d1c235903868f/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:51.265173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:51.312984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:51.314712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00e90c-92f2-4292-b5a9-628d71bcd6a1 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:51.329677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 937/1853] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:51.330962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.331434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.331849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.382653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:51.426381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] MFA Rules not processed for user `8cf1d668bb904c448f5d1c235903868f`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:51.427637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:51.428424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6ee88-628c-4ae6-a5d3-ff1ba62cb4df admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:51.435422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:51.436408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.436817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.437252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.438072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:51.440620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:51.500084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 917/1854] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:19:51 2022] POST /identity/v3/projects => generated 368 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:51.504473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:51.601205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 938/1855] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:51.688949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3063f-87eb-4dd0-8869-03616b46104f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:51.702746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:51.703657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.703956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.704267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.705000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:51.709388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:51.777917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 918/1856] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:19:51 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:19:51.779418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:51.801772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185273f-cbce-48b2-8ae5-d55ede2dd149 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:51.835178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:51.835913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.836606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.836888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:51.837723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:51.842271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:51.870010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 939/1857] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:51 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:19:51.877567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:51.883982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:51.917449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6074-f26c-427d-bebf-475e17c821a4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:51.939332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:51.943263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:51.943564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:51.945523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] PATH_INFO: `/v3/projects/9f9cd1a169b84348b51b5bbbebbcd298/users/9a8e57abcce74776903eb98081d9e6ba/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.008501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9cd1a169b84348b51b5bbbebbcd298, user_id=9a8e57abcce74776903eb98081d9e6ba, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:52.011768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:52.040098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 919/1858] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:51 2022] PUT /identity/v3/projects/9f9cd1a169b84348b51b5bbbebbcd298/users/9a8e57abcce74776903eb98081d9e6ba/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:52.044580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:52.096738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f067-b203-4688-a746-feb21ed6c887 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:52.116085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:52.136098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf149a-6655-4970-be28-b5efcb9fbf8f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:52.142389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:52.143559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:52.143559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:52.144115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.145023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:52.148690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:52.179988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:52.181491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:52.182286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:52.183178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 920/1859] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:19:52 2022] GET /identity/v3/roles => generated 1427 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:19:52.183564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.184254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:52.196673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b742a-ea8a-48c0-98a9-7ae15e7cdc6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:52.213877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735375-7498-4e93-8284-fd507a78da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:52.219036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735375-7498-4e93-8284-fd507a78da3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:52.219718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735375-7498-4e93-8284-fd507a78da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:52.220133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735375-7498-4e93-8284-fd507a78da3e admin admin] PATH_INFO: `/v3/projects/9f9cd1a169b84348b51b5bbbebbcd298/users/9a8e57abcce74776903eb98081d9e6ba/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.225178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735375-7498-4e93-8284-fd507a78da3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9cd1a169b84348b51b5bbbebbcd298, user_id=9a8e57abcce74776903eb98081d9e6ba, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:52.228352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735375-7498-4e93-8284-fd507a78da3e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:52.278600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 921/1860] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:19:52 2022] PUT /identity/v3/projects/9f9cd1a169b84348b51b5bbbebbcd298/users/9a8e57abcce74776903eb98081d9e6ba/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:52.282216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:52.282513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:52.282798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.336618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] MFA Rules not processed for user `9a8e57abcce74776903eb98081d9e6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:52.338267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:52.342286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:52.345532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:52.345775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:52.359228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 940/1861] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:52.558881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:52.563847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 922/1862] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:52.569682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236cba-2ec5-44fc-96dd-d17f06ba339b service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:52.655811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186289fc-1386-4a38-b6c5-63905bb04444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:52.656907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186289fc-1386-4a38-b6c5-63905bb04444 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:52.665500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186289fc-1386-4a38-b6c5-63905bb04444 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:52.666020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186289fc-1386-4a38-b6c5-63905bb04444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.747532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:52.762198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3989-342c-48ee-9bb4-a397c2a744b9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:52.771138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def04656-c3f3-4dda-b831-7dc5adc325ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:52.773416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04656-c3f3-4dda-b831-7dc5adc325ec service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:52.776537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04656-c3f3-4dda-b831-7dc5adc325ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:52.776831 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04656-c3f3-4dda-b831-7dc5adc325ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:52.799307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186289fc-1386-4a38-b6c5-63905bb04444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:52.801920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def04656-c3f3-4dda-b831-7dc5adc325ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:52.803429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def04656-c3f3-4dda-b831-7dc5adc325ec service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:52.808629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186289fc-1386-4a38-b6c5-63905bb04444 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:52.844546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 941/1863] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:52.845233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 923/1864] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:55.207851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9f1f-72b7-4389-8668-d7c81e63b2d9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:55.210238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9f1f-72b7-4389-8668-d7c81e63b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:55.210765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9f1f-72b7-4389-8668-d7c81e63b2d9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:55.213422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 942/1865] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:19:55 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:55.285005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:55.285782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:55.285946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:55.350825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9f53-3fc2-4dc7-ad3c-ec8db89100e9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:55.350825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9f53-3fc2-4dc7-ad3c-ec8db89100e9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:55.350825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9f53-3fc2-4dc7-ad3c-ec8db89100e9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:55.350825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 943/1866] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:19:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:55.361293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:55.362814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:55.518319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:55.518934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:55.519377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:55.568326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:55.574788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:55.600867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 924/1867] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:55.625710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 944/1868] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:55.938447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:55.940025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:55.944210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:55.966495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:55.980291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a6022-f014-4c64-9880-365149dd7d43 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:56.000026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:56.001232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:56.005903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:56.006624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:56.038496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:56.040207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:56.090878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 925/1869] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:56.091866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:56.095434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:56.135975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d44b5-9835-475a-bb86-72cb520af26a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:56.144838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:56.146091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:56.146520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:56.146936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] PATH_INFO: `/v3/users/0c491043276b4d3386cd0ead71d6b9cd` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:56.148396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c491043276b4d3386cd0ead71d6b9cd)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:56.159949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:56.277274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068063-6991-4e3c-8d76-86ca4d6b3d2a service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:56.282743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:56.283992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:56.284216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:56.284674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] PATH_INFO: `/v3/users/1c960c78cdcc47f58bd6f8adab392a11` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:56.286588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c960c78cdcc47f58bd6f8adab392a11)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:56.296380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:56.319712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:56.342143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c491043276b4d3386cd0ead71d6b9cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.406040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c491043276b4d3386cd0ead71d6b9cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.407350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c491043276b4d3386cd0ead71d6b9cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.423347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c491043276b4d3386cd0ead71d6b9cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.424239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c491043276b4d3386cd0ead71d6b9cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.453046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 945/1870] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:55 2022] DELETE /identity/v3/users/0c491043276b4d3386cd0ead71d6b9cd => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:19:56.455063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:56.458009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:56.477075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c960c78cdcc47f58bd6f8adab392a11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.478209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c960c78cdcc47f58bd6f8adab392a11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.480554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c960c78cdcc47f58bd6f8adab392a11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.542665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c960c78cdcc47f58bd6f8adab392a11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.553310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a9c44cf4-de92-4033-87db-062fba57ef5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c960c78cdcc47f58bd6f8adab392a11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:56.616915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 926/1871] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:56 2022] DELETE /identity/v3/users/1c960c78cdcc47f58bd6f8adab392a11 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:56.618705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d516-9da2-44f4-a97a-0697f5f4b466 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:56.620932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d516-9da2-44f4-a97a-0697f5f4b466 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:56.625265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d516-9da2-44f4-a97a-0697f5f4b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:56.670189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97550f-86eb-4a45-b1f5-0c5a747f59be admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:56.671667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dde4d516-9da2-44f4-a97a-0697f5f4b466 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:56.674836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dde4d516-9da2-44f4-a97a-0697f5f4b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:56.757763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:56.860273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 927/1872] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:56.860273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:56.860273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:56.860273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:56.867292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:56.867712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:56.868021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:56.868278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:56.871356 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:56.888224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:56.890302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:56.890921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:56.892663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:56.912721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 928/1873] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:56.914356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:56.915886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 946/1874] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:56.917055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:56.930862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:56.934465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:57.028462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e30ec8-fde2-46b3-95c9-794394082ba2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:57.039191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:57.040254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:57.040875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:57.042369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:57.057940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:57.060156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:57.076111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 929/1875] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:57.088700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a422097-7d52-4c5b-a851-9c6e8eb6d1d8 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:57.094829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:57.095558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:57.096000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:57.096293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:57.110546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:57.112382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:57.130632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 947/1876] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:58.332860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:58.335083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:58.354893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3ef5-7595-48c6-ae9a-934754798010 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:58.368638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:58.370187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.370544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.370886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] PATH_INFO: `/v3/projects/a6be0c73f5914842aef67b413ff2fdb8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.373289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6be0c73f5914842aef67b413ff2fdb8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:58.378858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:58.452404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:58.490100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:58.496878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:58.538894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6be0c73f5914842aef67b413ff2fdb8', 'request_id': 'req-9bbde7f2-2564-4494-8828-325d0d72a157'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.542605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535cbc-7409-439e-b58f-a7b48765bf1b service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:58.555021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6be0c73f5914842aef67b413ff2fdb8', 'request_id': 'req-9bbde7f2-2564-4494-8828-325d0d72a157'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.568676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6be0c73f5914842aef67b413ff2fdb8', 'request_id': 'req-9bbde7f2-2564-4494-8828-325d0d72a157'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.612730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] The token cache is being invalidate because project a6be0c73f5914842aef67b413ff2fdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:58.613433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.614546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.624014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 930/1877] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:58 2022] DELETE /identity/v3/projects/a6be0c73f5914842aef67b413ff2fdb8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:58.628020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:58.633784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:58.687703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:58.688523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.688819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.689094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] PATH_INFO: `/v3/projects/6532e8421cf04b908e7b89b09f447ddb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.691641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6532e8421cf04b908e7b89b09f447ddb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:58.693511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:58.755655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbde7f2-2564-4494-8828-325d0d72a157 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:58.790811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6532e8421cf04b908e7b89b09f447ddb', 'request_id': 'req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.801607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6532e8421cf04b908e7b89b09f447ddb', 'request_id': 'req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.804226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:58.812904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6532e8421cf04b908e7b89b09f447ddb', 'request_id': 'req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.833202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] The token cache is being invalidate because project 6532e8421cf04b908e7b89b09f447ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:58.833486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.834234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.835929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 948/1878] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:58 2022] DELETE /identity/v3/projects/6532e8421cf04b908e7b89b09f447ddb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:58.839929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:58.839929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:58.874471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:58.875545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.876045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.876362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] PATH_INFO: `/v3/users/4789030c63054105b2ca824ae06dbc64` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.877872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4789030c63054105b2ca824ae06dbc64)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:58.880020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:58.933657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea91cc-5d65-42b1-bb09-e473df7e4ed2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:58.939062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:58.940284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.940605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.941033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] PATH_INFO: `/v3/users/9e46f723b186463db955aa5752cf3ec6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.942447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e46f723b186463db955aa5752cf3ec6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:58.944645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:58.955025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4789030c63054105b2ca824ae06dbc64'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.956450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4789030c63054105b2ca824ae06dbc64'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.957667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4789030c63054105b2ca824ae06dbc64'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:58.965312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:58.996837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4789030c63054105b2ca824ae06dbc64'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.012674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4789030c63054105b2ca824ae06dbc64'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.042997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 931/1879] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:58 2022] DELETE /identity/v3/users/4789030c63054105b2ca824ae06dbc64 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:59.044584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:59.047538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:59.061703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e46f723b186463db955aa5752cf3ec6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.097170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e46f723b186463db955aa5752cf3ec6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.099286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e46f723b186463db955aa5752cf3ec6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.115524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e46f723b186463db955aa5752cf3ec6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.116419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-de6eb6a4-d4a7-4c4c-bdaf-402d0d7722e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e46f723b186463db955aa5752cf3ec6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.143905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 949/1880] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:58 2022] DELETE /identity/v3/users/9e46f723b186463db955aa5752cf3ec6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:59.151092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:59.151545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:59.152305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:59.158042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aba564-48d7-41ce-8352-c053a07fbb5e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:59.175330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:59.177881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:59.245428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:59.246995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:59.247411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:59.247609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] PATH_INFO: `/v3/users/5389ff0736c7428582d1f28a7e958991` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:59.249673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5389ff0736c7428582d1f28a7e958991)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:59.252333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:59.271513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 950/1881] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:59.279763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:59.281321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:59.299945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:59.337910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5389ff0736c7428582d1f28a7e958991'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.339367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5389ff0736c7428582d1f28a7e958991'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.340368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5389ff0736c7428582d1f28a7e958991'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.358288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5389ff0736c7428582d1f28a7e958991'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.368851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5389ff0736c7428582d1f28a7e958991'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.382744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257ec9-7cc7-4f91-ab1b-420e7a2bc2ea None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:59.387917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:59.388718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:59.389534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:59.390030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:59.390030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:59.398182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:59.408632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 932/1882] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:19:59 2022] DELETE /identity/v3/users/5389ff0736c7428582d1f28a7e958991 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:59.441050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:59.445876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13b4e-f46b-448b-9883-78f758d12860 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:59.458870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 951/1883] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:19:59.592468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:59.594406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:59.704723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725095-43c7-43c5-88d0-c95db2f0739c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:59.712295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:59.713802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:59.713802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:59.713980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] PATH_INFO: `/v3/projects/330ab0f9024b4893bb43e58f74c7ce4c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:59.715473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330ab0f9024b4893bb43e58f74c7ce4c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:59.717961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:59.810186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330ab0f9024b4893bb43e58f74c7ce4c', 'request_id': 'req-ed4cc255-d7ba-495d-b02c-97dc1103ed71'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.824360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330ab0f9024b4893bb43e58f74c7ce4c', 'request_id': 'req-ed4cc255-d7ba-495d-b02c-97dc1103ed71'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.834913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330ab0f9024b4893bb43e58f74c7ce4c', 'request_id': 'req-ed4cc255-d7ba-495d-b02c-97dc1103ed71'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.857636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] The token cache is being invalidate because project 330ab0f9024b4893bb43e58f74c7ce4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:19:59.857987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.859190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ed4cc255-d7ba-495d-b02c-97dc1103ed71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:19:59.866723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 933/1884] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:19:59 2022] DELETE /identity/v3/projects/330ab0f9024b4893bb43e58f74c7ce4c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:19:59.867472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:59.867919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:59.868055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:59.893728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:59.903164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:00.023846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 952/1885] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:00.031783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.032005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.032764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.056571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:00.058273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:00.074916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 934/1886] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:00.076420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.093835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e03a6d-880c-4c77-a686-d57dcad0aa4d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.112595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.112595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.112595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.112595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.112904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:00.112904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.113734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.130510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 953/1887] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:00.135884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.145888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0817ae4-249a-46c4-9357-f6fea36eb5c2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.151105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.151788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.152123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.152348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.153177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.155243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.200701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 935/1888] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:00 2022] POST /identity/v3/projects => generated 388 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:00.205700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.227733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14896845-7d5d-4e31-81af-37e4cca88b76 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.230216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.232450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:00.362981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.364681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.365822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.366215 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.367113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.370506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.394848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6048fe9-a9ce-492a-a629-d7f216a2adb9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.402814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.403749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.404033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.404311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] PATH_INFO: `/v3/projects/1f2a3a85806c4d9499c12d2bc4279d68` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.405761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2a3a85806c4d9499c12d2bc4279d68)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.407806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.410425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:00.418414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 954/1889] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:00 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:00.421528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.445777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3faf-1d76-4578-915c-b0494684fd0b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.466487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.468726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.469271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.469737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.471207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.474269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.497173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 955/1890] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:00 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:00.498272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.499203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2a3a85806c4d9499c12d2bc4279d68', 'request_id': 'req-120840bb-e378-41b0-bf43-aed23f586866'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.502721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:00.513167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2a3a85806c4d9499c12d2bc4279d68', 'request_id': 'req-120840bb-e378-41b0-bf43-aed23f586866'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.533796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d356-3bc0-4ff9-b1b2-35affceac291 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.538786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2a3a85806c4d9499c12d2bc4279d68', 'request_id': 'req-120840bb-e378-41b0-bf43-aed23f586866'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.549570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:00.579075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] The token cache is being invalidate because project 1f2a3a85806c4d9499c12d2bc4279d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:00.579763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.580585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.583723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 936/1891] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:00 2022] DELETE /identity/v3/projects/1f2a3a85806c4d9499c12d2bc4279d68 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:00.584657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.587463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:00.641906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.643004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.643901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.644777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] PATH_INFO: `/v3/projects/2ff466300812440bac338d104e1a536b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.647268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff466300812440bac338d104e1a536b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.651658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.692543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120840bb-e378-41b0-bf43-aed23f586866 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.698382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:00.699826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:00.700109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:00.700490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:00.703202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:00.703202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:00.744637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 937/1892] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:00 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:00.745826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.758432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:00.772686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff466300812440bac338d104e1a536b', 'request_id': 'req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.793037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff466300812440bac338d104e1a536b', 'request_id': 'req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.793594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab5894-780b-4207-9da9-35d48fe69112 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:00.805859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff466300812440bac338d104e1a536b', 'request_id': 'req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.834069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] The token cache is being invalidate because project 2ff466300812440bac338d104e1a536b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:00.834457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.835821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:00.843500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 956/1893] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:00 2022] DELETE /identity/v3/projects/2ff466300812440bac338d104e1a536b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:00.843500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:00.843500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.008501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddd0fd-41da-429d-bf12-36c54dba2ee4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:01.023080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0796f36-02e8-4566-9242-0597d29dfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:01.023440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:01.024235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0796f36-02e8-4566-9242-0597d29dfada admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.024407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0796f36-02e8-4566-9242-0597d29dfada admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.024585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0796f36-02e8-4566-9242-0597d29dfada admin admin] PATH_INFO: `/v3/projects/ace1c35c2d5943b99d2c7fee751f7ed7/users/7a79f4857c2247178abb0e663374cc29/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.026358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.027094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.028690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] PATH_INFO: `/v3/users/9a8e57abcce74776903eb98081d9e6ba` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.035568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8e57abcce74776903eb98081d9e6ba)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:01.044364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:01.066438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0796f36-02e8-4566-9242-0597d29dfada admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace1c35c2d5943b99d2c7fee751f7ed7, user_id=7a79f4857c2247178abb0e663374cc29, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:01.072839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0796f36-02e8-4566-9242-0597d29dfada admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:01.115550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 957/1894] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:00 2022] PUT /identity/v3/projects/ace1c35c2d5943b99d2c7fee751f7ed7/users/7a79f4857c2247178abb0e663374cc29/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:01.119431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.120340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.121167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.140541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:01.176445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:01.177810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.210452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8e57abcce74776903eb98081d9e6ba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.212198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8e57abcce74776903eb98081d9e6ba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.214277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8e57abcce74776903eb98081d9e6ba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.224645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:01.263321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8e57abcce74776903eb98081d9e6ba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.290133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9519abb9-b944-4468-9225-7608876d5001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8e57abcce74776903eb98081d9e6ba'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.323607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 938/1895] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:00 2022] DELETE /identity/v3/users/9a8e57abcce74776903eb98081d9e6ba => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:01.325973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dea0e-0417-4d23-b6ec-7f251e179412 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.326510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dea0e-0417-4d23-b6ec-7f251e179412 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.326990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dea0e-0417-4d23-b6ec-7f251e179412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.334861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 958/1896] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:01.336635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:01.338814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.363229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde5a5-7f26-420b-adb4-964cd7180dc4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:01.376523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3b4dea0e-0417-4d23-b6ec-7f251e179412 None None] MFA Rules not processed for user `7a79f4857c2247178abb0e663374cc29`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:01.378455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3b4dea0e-0417-4d23-b6ec-7f251e179412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.528871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:01.530869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.533038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.533038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] PATH_INFO: `/v3/users/cb95d50620cf4e6ebf47fcd421cc6037` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.535022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb95d50620cf4e6ebf47fcd421cc6037)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:01.537617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:01.554343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 939/1897] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:01.554742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.554894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.555109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.584539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:01.587314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.599293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 940/1898] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:01.600693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:01.601901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.642388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987613f-0836-4fa8-8778-42848acb9526 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:01.651127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb95d50620cf4e6ebf47fcd421cc6037'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.659142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ddf61-9d10-41fc-b126-d3e2ea14bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:01.661666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ddf61-9d10-41fc-b126-d3e2ea14bf50 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.662015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ddf61-9d10-41fc-b126-d3e2ea14bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.662304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ddf61-9d10-41fc-b126-d3e2ea14bf50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.664845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ddf61-9d10-41fc-b126-d3e2ea14bf50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:01.669095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ddf61-9d10-41fc-b126-d3e2ea14bf50 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:01.669493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb95d50620cf4e6ebf47fcd421cc6037'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.670363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb95d50620cf4e6ebf47fcd421cc6037'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.684347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb95d50620cf4e6ebf47fcd421cc6037'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.687034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb95d50620cf4e6ebf47fcd421cc6037'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:01.717983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 959/1899] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:01 2022] DELETE /identity/v3/users/cb95d50620cf4e6ebf47fcd421cc6037 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:01.721689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:01.725354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.745728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 941/1900] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:01 2022] POST /identity/v3/projects => generated 390 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:01.748785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.749189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.750867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.801691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:01.807041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.851806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:01.897423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf1318-2f24-4c71-b229-c064271bc033 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:01.974877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 942/1901] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:01.976172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:01.978339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:01.996254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:01.997018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:01.997333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:01.997605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:01.998910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:01.999254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.001040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.021213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2e14-05cb-4355-b8f6-f41fa52e290f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.021418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 960/1902] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:02.024314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.026686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.044949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.045791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.046083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.046415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.047573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.051575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.060357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded1ac3-d340-48e0-b385-2ed078c42597 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.067903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.069313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.069763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.070265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] PATH_INFO: `/v3/projects/9f9cd1a169b84348b51b5bbbebbcd298` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.072596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9cd1a169b84348b51b5bbbebbcd298)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.076420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:02.077938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.152601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 943/1903] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:01 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:02.152601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.157264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.200499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9cd1a169b84348b51b5bbbebbcd298', 'request_id': 'req-0b386286-68c9-436a-8657-6f98f59def6a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:02.221733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9cd1a169b84348b51b5bbbebbcd298', 'request_id': 'req-0b386286-68c9-436a-8657-6f98f59def6a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:02.234533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9cd1a169b84348b51b5bbbebbcd298', 'request_id': 'req-0b386286-68c9-436a-8657-6f98f59def6a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:02.258352 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] The token cache is being invalidate because project 9f9cd1a169b84348b51b5bbbebbcd298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:02.258640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:02.263162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:02.265018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c097d-9341-4379-b02c-2b691acc0b07 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.265239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 961/1904] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:02 2022] DELETE /identity/v3/projects/9f9cd1a169b84348b51b5bbbebbcd298 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:02.266129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.267677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.348435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.349385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.349692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.350137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.352779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.379170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b386286-68c9-436a-8657-6f98f59def6a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.387253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.388426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.388858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.389336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.390566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.396424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.414787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:02.437503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 962/1905] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:02 2022] POST /identity/v3/projects => generated 386 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:02.437503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.441561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.451960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.454205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce369c2f-6b08-43fc-9e12-484b48d5fc20 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.468548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 944/1906] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:02.469836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.470231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.470613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.502083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:02.503844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.562856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acb3c-3145-418c-b339-e0ed764f6321 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.572918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.574754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.575514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.576706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.579145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.582430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.600339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 963/1907] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:02 2022] GET /identity/v3/roles => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:02.601920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.608706 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:02.621436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cab880-b3e4-474d-adc6-85d05ca763cf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.625907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 945/1908] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:02.627050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.629478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270564-9ce4-4dd3-be66-d3f9c6a311e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.630674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270564-9ce4-4dd3-be66-d3f9c6a311e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.631175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270564-9ce4-4dd3-be66-d3f9c6a311e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.631665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270564-9ce4-4dd3-be66-d3f9c6a311e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.633952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270564-9ce4-4dd3-be66-d3f9c6a311e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.639483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bc1de-6732-4d2a-92db-4cbdee6488ec None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.639793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270564-9ce4-4dd3-be66-d3f9c6a311e4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.646028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.647311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.647655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.647999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] PATH_INFO: `/v3/projects/36f257b5be1c4828b6361e1a0585756a/users/a1218166c2904b1bbecf3a014e4d7d36/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.676068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f257b5be1c4828b6361e1a0585756a, user_id=a1218166c2904b1bbecf3a014e4d7d36, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.678999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.694988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 964/1909] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:02 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:02.697158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.697499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.697927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.723008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 946/1910] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:02 2022] PUT /identity/v3/projects/36f257b5be1c4828b6361e1a0585756a/users/a1218166c2904b1bbecf3a014e4d7d36/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:02.725579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.764052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:02.767111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:02.851426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 965/1911] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:02.851830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.864917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a106c6-d8ba-4252-ad95-11d49b96f372 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.868908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9203-fcb0-4bb7-b569-c123562afd08 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.870415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.871196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.871552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.871907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.872731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.874701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.876654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.878301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.878856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.879446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.880962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.882863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.889807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 966/1912] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:02 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:02.891162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.898440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 947/1913] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:02 2022] GET /identity/v3/roles => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:02.902332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.909733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a586b-fef0-4ae9-9c67-fa84ac04e09f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.915286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bcb8a-f05c-4806-bad8-a85df07d6d49 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.917995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.918811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.921190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.921190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.921190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:02.921190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.922435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.938323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:02.939225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:02.939396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:02.939555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 967/1914] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:02.939757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] PATH_INFO: `/v3/projects/36f257b5be1c4828b6361e1a0585756a/users/a1218166c2904b1bbecf3a014e4d7d36/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:02.940554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:02.946624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f257b5be1c4828b6361e1a0585756a, user_id=a1218166c2904b1bbecf3a014e4d7d36, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:02.950454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:02.968580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11058c-0170-4ab8-b1c1-8b829c4ab0bc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:02.980388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 948/1915] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:02 2022] PUT /identity/v3/projects/36f257b5be1c4828b6361e1a0585756a/users/a1218166c2904b1bbecf3a014e4d7d36/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:02.980388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.071884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:03.097027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.097763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.098050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.098461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.099608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.101628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.123080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979892-bad8-481d-b8fa-1a60fdf95d2a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.131101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24410c-94a3-400a-9d4c-2b2e9d388a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.131807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24410c-94a3-400a-9d4c-2b2e9d388a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.132093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24410c-94a3-400a-9d4c-2b2e9d388a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.132374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24410c-94a3-400a-9d4c-2b2e9d388a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.133112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24410c-94a3-400a-9d4c-2b2e9d388a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.135697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24410c-94a3-400a-9d4c-2b2e9d388a79 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.138784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 968/1916] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:02 2022] GET /identity/v3/roles => generated 1427 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:03.139972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.146742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.176963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d50e-d370-4ab6-93e3-bdc350483d8a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.198226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.199840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.200570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 949/1917] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:02 2022] POST /identity/v3/projects => generated 386 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:03.200857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.201840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] PATH_INFO: `/v3/projects/4ad78605c1434d6cbc1cdf161b8f9b96` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.202033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.202321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.202603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.204320 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad78605c1434d6cbc1cdf161b8f9b96)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.207680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.243150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] MFA Rules not processed for user `a1218166c2904b1bbecf3a014e4d7d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:03.244869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.288457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:03.300456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad78605c1434d6cbc1cdf161b8f9b96', 'request_id': 'req-db3384cc-4083-48af-abdf-639d7581ceaa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.312674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad78605c1434d6cbc1cdf161b8f9b96', 'request_id': 'req-db3384cc-4083-48af-abdf-639d7581ceaa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.321865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad78605c1434d6cbc1cdf161b8f9b96', 'request_id': 'req-db3384cc-4083-48af-abdf-639d7581ceaa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.337825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] The token cache is being invalidate because project 4ad78605c1434d6cbc1cdf161b8f9b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:03.338127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.339695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.341840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 969/1918] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:03 2022] DELETE /identity/v3/projects/4ad78605c1434d6cbc1cdf161b8f9b96 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:03.343258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.344714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.349179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 950/1919] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:03.350463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.434925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb70c70-611d-489c-9488-1da8e315d43c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.524733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3384cc-4083-48af-abdf-639d7581ceaa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.550970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.552620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.558694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.559239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] PATH_INFO: `/v3/projects/1e9f6674b01d455fa02eadd95970b7cf/users/a49a4d4fd9ff4859b8787ee8609f5ae1/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.592840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9f6674b01d455fa02eadd95970b7cf, user_id=a49a4d4fd9ff4859b8787ee8609f5ae1, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.597813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.598609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.598968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.599475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.599642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.600168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.602329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.639148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 951/1920] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:03 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:03.641688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.641859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 970/1921] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:03 2022] PUT /identity/v3/projects/1e9f6674b01d455fa02eadd95970b7cf/users/a49a4d4fd9ff4859b8787ee8609f5ae1/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:03.642838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.649161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.658935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.684718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a06ead-b122-4853-bec6-12caa3a3fec9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.788277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450ed00-013f-4496-9d68-f64056b852b2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.798334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.801157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.801607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.801996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.808492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.824237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:03.829579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.837312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.837749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.838147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] PATH_INFO: `/v3/users/8cf1d668bb904c448f5d1c235903868f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.841537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf1d668bb904c448f5d1c235903868f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.847076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.854937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:03.929646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.931186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:03.944103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf1d668bb904c448f5d1c235903868f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.947644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 971/1922] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:03.950095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:03.951795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf1d668bb904c448f5d1c235903868f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.953164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:03.953667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf1d668bb904c448f5d1c235903868f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.981825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf96cf-b123-41e0-8cdc-b8eaff39bdfe service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:03.986007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf1d668bb904c448f5d1c235903868f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:03.988367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc675-7089-4604-91d1-d17fbbf05062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:03.989017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc675-7089-4604-91d1-d17fbbf05062 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:03.989426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc675-7089-4604-91d1-d17fbbf05062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:03.989821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc675-7089-4604-91d1-d17fbbf05062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:03.990623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc675-7089-4604-91d1-d17fbbf05062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:03.992698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc675-7089-4604-91d1-d17fbbf05062 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.007636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf1d668bb904c448f5d1c235903868f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.021974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 972/1923] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:03 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:04.021974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.021974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.021974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.031683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 952/1924] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:03 2022] DELETE /identity/v3/users/8cf1d668bb904c448f5d1c235903868f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:04.032701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.035514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.093522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] MFA Rules not processed for user `a49a4d4fd9ff4859b8787ee8609f5ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:04.095037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.153469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2223b-2d3b-4ab1-a2a6-70ab089352dc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.162577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.163478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.163678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.164018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.164906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.167313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.190314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 953/1925] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:04 2022] GET /identity/v3/roles => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:04.190966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.193678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.227756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7b98-cc45-4f9f-9004-ca04b5a09b1a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.241588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 973/1926] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:04.243244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.244808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.246013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.246308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.246589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] PATH_INFO: `/v3/users/7a79f4857c2247178abb0e663374cc29` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.247919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a79f4857c2247178abb0e663374cc29)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.249965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.271488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d733c-f544-4f50-b3f6-527a947421ec None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.284506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.285910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.286349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.286831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] PATH_INFO: `/v3/projects/a4ff507beacf469a8555baa5b2520936/users/084c6afa3d2d4200a206c46427d915e5/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.319771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ff507beacf469a8555baa5b2520936, user_id=084c6afa3d2d4200a206c46427d915e5, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.325101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.341822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a79f4857c2247178abb0e663374cc29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.342576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a79f4857c2247178abb0e663374cc29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.343256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a79f4857c2247178abb0e663374cc29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.351920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 974/1927] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:04 2022] PUT /identity/v3/projects/a4ff507beacf469a8555baa5b2520936/users/084c6afa3d2d4200a206c46427d915e5/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:04.354156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.356553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.362763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a79f4857c2247178abb0e663374cc29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.372840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-041d1099-6d2a-4f03-9e25-5b2279370076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a79f4857c2247178abb0e663374cc29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.375308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:04.396469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 954/1928] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:04 2022] DELETE /identity/v3/users/7a79f4857c2247178abb0e663374cc29 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:04.398672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e0e10-a7cc-4aac-8ff3-72a6c8c26aa2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.398973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e0e10-a7cc-4aac-8ff3-72a6c8c26aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.399258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e0e10-a7cc-4aac-8ff3-72a6c8c26aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.433470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fe3e0e10-a7cc-4aac-8ff3-72a6c8c26aa2 None None] MFA Rules not processed for user `084c6afa3d2d4200a206c46427d915e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:04.434751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fe3e0e10-a7cc-4aac-8ff3-72a6c8c26aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.457614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:04.463159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8148-9267-4d62-b710-084fe7e7e7f2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.524468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 955/1929] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:04.525862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.526221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.526602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.558343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.558802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.560105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:04.561396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.563017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.563323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.564243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.566455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.575993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 956/1930] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:04.577463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.579716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.603938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 975/1931] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/projects => generated 384 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:04.603938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.603938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.604293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf00b02-d2f3-40cc-af1f-45c097c38555 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.684567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f1bb-9be1-405b-866c-dc5a617abbed admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.690698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.691453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.691772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.692050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.692906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.694830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.695470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.696236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.696677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.697098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] PATH_INFO: `/v3/projects/0ce024c54ed748e8a8a1c8c2a5cc7b2b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.698540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce024c54ed748e8a8a1c8c2a5cc7b2b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.700800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.739978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 957/1932] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/projects => generated 388 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:04.739978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.741072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.768444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce024c54ed748e8a8a1c8c2a5cc7b2b', 'request_id': 'req-f518c4ec-4438-4187-ba1e-d75fea77889d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.787854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce024c54ed748e8a8a1c8c2a5cc7b2b', 'request_id': 'req-f518c4ec-4438-4187-ba1e-d75fea77889d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.796986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce024c54ed748e8a8a1c8c2a5cc7b2b', 'request_id': 'req-f518c4ec-4438-4187-ba1e-d75fea77889d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.813288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] The token cache is being invalidate because project 0ce024c54ed748e8a8a1c8c2a5cc7b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:04.813593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.814457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:04.816459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 976/1933] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:04 2022] DELETE /identity/v3/projects/0ce024c54ed748e8a8a1c8c2a5cc7b2b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:04.818115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.820123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.853035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6af6-a03d-45b3-b62a-148e7ba86329 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.868189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:04.870520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:04.934839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.935717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.936059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.936502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.938702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.947605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518c4ec-4438-4187-ba1e-d75fea77889d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:04.953761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.954864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db6c15-2da4-42a1-8b3c-5e407c828c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:04.955148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.956315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6c15-2da4-42a1-8b3c-5e407c828c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:04.956461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6c15-2da4-42a1-8b3c-5e407c828c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:04.956712 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6c15-2da4-42a1-8b3c-5e407c828c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:04.957732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db6c15-2da4-42a1-8b3c-5e407c828c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:04.961184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db6c15-2da4-42a1-8b3c-5e407c828c0f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:04.969183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 958/1934] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:04.970265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:04.974757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:04.993638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5447b3-6f7e-4c4d-9469-2a0a0a3983c7 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.002122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.004183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.004673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.005355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.006869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.009380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.010910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 977/1935] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:05.012647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.012943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.013256 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.042035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 959/1936] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:04 2022] POST /identity/v3/users => generated 295 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:05.049618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.070147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f454fd6-4100-4461-b278-4765ea04110a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.075309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.076295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.076591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.076978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.078609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.079852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.080141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:05.084106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:05.097532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 960/1937] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:05 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:05.100977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.116435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 978/1938] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:05.117630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.122779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aef4f-66a1-4154-9f35-91d15a12205b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.128214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7c22-4b5a-427f-8168-a507b9c62287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.129003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b74089-df7f-462c-a530-0ef013b694a9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.129678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7c22-4b5a-427f-8168-a507b9c62287 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.130478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7c22-4b5a-427f-8168-a507b9c62287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.131761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7c22-4b5a-427f-8168-a507b9c62287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.133503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7c22-4b5a-427f-8168-a507b9c62287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.135121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.135882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7c22-4b5a-427f-8168-a507b9c62287 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.136807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.137333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.138017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] PATH_INFO: `/v3/projects/bbb873bdb8354ff48f04dca188509228/users/58cb004dfe2843a29feec903c45e0444/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.151417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 961/1939] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:05 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:05.154052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.154700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.155149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.179498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb873bdb8354ff48f04dca188509228, user_id=58cb004dfe2843a29feec903c45e0444, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.182611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:05.183626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.183969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:05.198017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 962/1940] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:05.199928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.204426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 979/1941] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:05 2022] PUT /identity/v3/projects/bbb873bdb8354ff48f04dca188509228/users/58cb004dfe2843a29feec903c45e0444/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:05.205487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.230784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9720e6-bf8b-451c-b217-175494117f24 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.318143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba674fb1-9a84-42e3-8103-79a0d2127e24 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.330377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.331161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.331627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.332188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.333782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:05.333782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.335603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.336176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.336619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.336908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.337223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.338601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.340250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.358397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 963/1942] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:05 2022] GET /identity/v3/roles => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:05.358609 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 980/1943] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:05.358699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.360165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.370692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2171a0-6aba-43b6-8208-f5deffd31cc3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.376376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886c22a-58ca-48ed-bdcc-b8824dfb54e4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.389162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.389162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.389162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.389535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] PATH_INFO: `/v3/projects/ccab86c9649c42b594471675449a9bb2/users/bd68bb3262e44fa2a12cb4a95962789a/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.391070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.391983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.392426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.392869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.393909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.396707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.410713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 964/1944] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:05 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:05.411900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.415613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccab86c9649c42b594471675449a9bb2, user_id=bd68bb3262e44fa2a12cb4a95962789a, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.418905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.423537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc48faa-390a-4ea2-9105-504de5927db0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.432402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440f3a8-67fd-4d54-8849-b4f6aefe7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.433320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440f3a8-67fd-4d54-8849-b4f6aefe7f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.433776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440f3a8-67fd-4d54-8849-b4f6aefe7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.434198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440f3a8-67fd-4d54-8849-b4f6aefe7f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.435122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440f3a8-67fd-4d54-8849-b4f6aefe7f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.438022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440f3a8-67fd-4d54-8849-b4f6aefe7f40 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.513583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 981/1945] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:05 2022] PUT /identity/v3/projects/ccab86c9649c42b594471675449a9bb2/users/bd68bb3262e44fa2a12cb4a95962789a/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:05.513583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.541030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 965/1946] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:05 2022] POST /identity/v3/projects => generated 382 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:05.543186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.543805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.544351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.602200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] MFA Rules not processed for user `bd68bb3262e44fa2a12cb4a95962789a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:05.603537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:05.618144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:05.638945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109c8c3-2e2d-47be-8ff7-11674da9ccf1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.641727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:05.710331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 966/1947] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:05.712031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.741558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.743326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.743857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.744388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] PATH_INFO: `/v3/projects/bbb873bdb8354ff48f04dca188509228/users/58cb004dfe2843a29feec903c45e0444/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.747601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb873bdb8354ff48f04dca188509228, user_id=58cb004dfe2843a29feec903c45e0444, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.751293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.786412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 982/1948] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:05 2022] PUT /identity/v3/projects/bbb873bdb8354ff48f04dca188509228/users/58cb004dfe2843a29feec903c45e0444/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:05.787580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.862117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00b9a5-f704-47fb-82f4-13ca42b2117f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.892830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a24ee-fa3b-467a-a998-5b6750cba68d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:05.898755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.899996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.900690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.901305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.902936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.905830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:05.949906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 983/1949] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:05 2022] POST /identity/v3/projects => generated 388 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:05.952262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:05.957876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:05.964830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cd08c-ccdf-4205-9473-4d92cf1dafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:05.965771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cd08c-ccdf-4205-9473-4d92cf1dafbc admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:05.966201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cd08c-ccdf-4205-9473-4d92cf1dafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:05.966568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cd08c-ccdf-4205-9473-4d92cf1dafbc admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:05.967926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cd08c-ccdf-4205-9473-4d92cf1dafbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:05.970256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cd08c-ccdf-4205-9473-4d92cf1dafbc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.007693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 967/1950] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:05 2022] POST /identity/v3/users => generated 292 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:06.009392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.009651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.009923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.078461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] MFA Rules not processed for user `58cb004dfe2843a29feec903c45e0444`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:06.080530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.082396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24818406-e487-4543-8002-be1e395dd1e2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.092112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.093028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.093490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.093768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] PATH_INFO: `/v3/projects/ace1c35c2d5943b99d2c7fee751f7ed7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.096465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace1c35c2d5943b99d2c7fee751f7ed7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.098538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.119695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:06.186046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:06.192013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace1c35c2d5943b99d2c7fee751f7ed7', 'request_id': 'req-d27b275d-e32c-401a-b3b9-2436b23a93c5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.201616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace1c35c2d5943b99d2c7fee751f7ed7', 'request_id': 'req-d27b275d-e32c-401a-b3b9-2436b23a93c5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.208343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace1c35c2d5943b99d2c7fee751f7ed7', 'request_id': 'req-d27b275d-e32c-401a-b3b9-2436b23a93c5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.220677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] The token cache is being invalidate because project ace1c35c2d5943b99d2c7fee751f7ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:06.223469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.223469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.225078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 984/1951] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:05 2022] DELETE /identity/v3/projects/ace1c35c2d5943b99d2c7fee751f7ed7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:06.225078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.230831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.236518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 968/1952] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:06.238492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.259073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d02b-7a82-4b6c-a52e-e9c6207b54bb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.339228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b275d-e32c-401a-b3b9-2436b23a93c5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.345296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.346151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.346719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.347014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.347755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.349883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.367688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.368915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.369469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.370141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.371470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.374282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.387110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 969/1953] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:06 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:06.387870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.389765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.391781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 985/1954] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:06 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:06.392973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.396513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.408083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895c86-1a5f-4f6c-806a-6a84689430fd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.419235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.420143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.420422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.420738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] PATH_INFO: `/v3/users/a1218166c2904b1bbecf3a014e4d7d36` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.422059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1218166c2904b1bbecf3a014e4d7d36)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.424058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.466909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ad92-4a0a-458a-a343-ab2063097f91 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.471779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.472590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.473004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.473319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.475566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.486912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1218166c2904b1bbecf3a014e4d7d36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.487660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1218166c2904b1bbecf3a014e4d7d36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.488354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1218166c2904b1bbecf3a014e4d7d36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.507775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1218166c2904b1bbecf3a014e4d7d36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.519552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1218166c2904b1bbecf3a014e4d7d36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:06.547384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 970/1955] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:06 2022] DELETE /identity/v3/users/a1218166c2904b1bbecf3a014e4d7d36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:06.547384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.547384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.584533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:06.615253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.617833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.630274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 986/1956] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:06.631129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.654194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5a9df-89e5-41cd-bc44-b06dbd4e7959 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.674513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:06.703310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c75a7-19f3-44e3-bc0b-5f84524b3eea admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.719694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.720553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.720772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.721048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.722417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.727275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.754149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 971/1957] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:06 2022] GET /identity/v3/roles => generated 1427 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:06.756011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.775557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609d77f-d97c-43af-ae5c-6b522ab0ee6e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.788362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f733334-41c0-4528-830d-f630798865cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.790742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733334-41c0-4528-830d-f630798865cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.791033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733334-41c0-4528-830d-f630798865cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.792461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733334-41c0-4528-830d-f630798865cc admin admin] PATH_INFO: `/v3/projects/49b989056ff9419189c995545ab98106/users/1f71343905e8440dbc94d35fb2b106db/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.807646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.808352 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.808633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.808904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.810072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.811753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.830914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f733334-41c0-4528-830d-f630798865cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b989056ff9419189c995545ab98106, user_id=1f71343905e8440dbc94d35fb2b106db, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:06.843374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f733334-41c0-4528-830d-f630798865cc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:06.843657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 987/1958] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:06 2022] GET /identity/v3/roles => generated 1427 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:06.847667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:06.850690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.887253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 972/1959] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:06 2022] PUT /identity/v3/projects/49b989056ff9419189c995545ab98106/users/1f71343905e8440dbc94d35fb2b106db/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:06.887538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af7d8a-0e40-4c77-8d9d-d74ff416729f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:06.898352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.898589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.899691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:06.967123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] MFA Rules not processed for user `1f71343905e8440dbc94d35fb2b106db`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:06.968541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:06.985696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:06.987123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:06.987601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:06.988066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] PATH_INFO: `/v3/projects/f06c313b138247e6b07b4c82ead1b7da/users/c184ea9211694aae82ef10d37ec453f9/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.025213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06c313b138247e6b07b4c82ead1b7da, user_id=c184ea9211694aae82ef10d37ec453f9, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.028430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.060245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 988/1960] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:06 2022] PUT /identity/v3/projects/f06c313b138247e6b07b4c82ead1b7da/users/c184ea9211694aae82ef10d37ec453f9/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:07.063204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.130161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 973/1961] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:07.140606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.177654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192bfcd-75bd-4db5-b631-16fa14c53db5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:07.185423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:07.187426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.191019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb63f0-18aa-4d77-8c07-0e35af564ef6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:07.191530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.191530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.192582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.195188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.223878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:07.226367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.226855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.228291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.229383 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.240423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.287616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 974/1962] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:07 2022] POST /identity/v3/projects => generated 380 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:07.295432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.297407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:07.302616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 989/1963] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:07 2022] GET /identity/v3/roles => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:20:07.304588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.317892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:07.325926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3542d6-0275-40e7-bdbc-618c75e0e5aa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:07.423202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:07.424387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.424956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.425396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.426224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.430095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.467847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 990/1964] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:07 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:07.468972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.489523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e746-1f0e-46f7-9a23-f147428290aa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:07.503426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee8f2-bdf8-4010-a067-1dbc535a11c4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:07.514504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:07.515312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.515600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.515907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] PATH_INFO: `/v3/projects/f06c313b138247e6b07b4c82ead1b7da/users/c184ea9211694aae82ef10d37ec453f9/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.517839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:07.518671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.519006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.520024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06c313b138247e6b07b4c82ead1b7da, user_id=c184ea9211694aae82ef10d37ec453f9, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.521376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] PATH_INFO: `/v3/projects/36f257b5be1c4828b6361e1a0585756a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.522886 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.525558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f257b5be1c4828b6361e1a0585756a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.527550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.571556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 991/1965] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:07 2022] PUT /identity/v3/projects/f06c313b138247e6b07b4c82ead1b7da/users/c184ea9211694aae82ef10d37ec453f9/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:07.578426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.624045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:07.649144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f257b5be1c4828b6361e1a0585756a', 'request_id': 'req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:07.669209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f257b5be1c4828b6361e1a0585756a', 'request_id': 'req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:07.682450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f257b5be1c4828b6361e1a0585756a', 'request_id': 'req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:07.699549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] The token cache is being invalidate because project 36f257b5be1c4828b6361e1a0585756a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:07.700162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:07.701531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4bb08f1e-d2ed-45e8-b510-8d2f56f3d8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:07.703768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 975/1966] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:07 2022] DELETE /identity/v3/projects/36f257b5be1c4828b6361e1a0585756a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:07.705979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542d07c-0d38-40fb-bf97-10b8b41ece83 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.706507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542d07c-0d38-40fb-bf97-10b8b41ece83 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.706994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542d07c-0d38-40fb-bf97-10b8b41ece83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.760366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b542d07c-0d38-40fb-bf97-10b8b41ece83 None None] MFA Rules not processed for user `c184ea9211694aae82ef10d37ec453f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:07.762168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b542d07c-0d38-40fb-bf97-10b8b41ece83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:07.765637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcdb6b-457d-44a2-89c1-f0377960de85 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:07.932046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:07.932883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.933352 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.933616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.934445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:07.936212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:07.939683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 976/1967] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:07.941770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:07.942093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:07.942321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:07.963486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 992/1968] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:07 2022] GET /identity/v3/roles => generated 1427 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:07.965432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:07.968336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:07.969703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:07.971356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:07.984029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 977/1969] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:07.985531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.001507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:08.026581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:08.032096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a89f0-5ed3-4a33-8d0a-8284fc6fe80b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.045503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6a5f-c755-48c3-9146-7fb391bb3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.048104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6a5f-c755-48c3-9146-7fb391bb3657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.048639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6a5f-c755-48c3-9146-7fb391bb3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.048964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6a5f-c755-48c3-9146-7fb391bb3657 admin admin] PATH_INFO: `/v3/projects/afe26a75aa3844a6926ec9fac8d90e08/users/9f399cb65ae34d51ae08623f1015fdaf/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.071606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6a5f-c755-48c3-9146-7fb391bb3657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe26a75aa3844a6926ec9fac8d90e08, user_id=9f399cb65ae34d51ae08623f1015fdaf, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.075343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6a5f-c755-48c3-9146-7fb391bb3657 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.103083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236dfa-5977-4dba-a276-a80f693f557c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.110759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 978/1970] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:07 2022] PUT /identity/v3/projects/afe26a75aa3844a6926ec9fac8d90e08/users/9f399cb65ae34d51ae08623f1015fdaf/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:08.113533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.114223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.114807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.142080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:08.142080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:08.177589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.178387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.178797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.179195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.222238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 979/1971] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:08.228778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.239460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc785-e77a-4afb-8fb2-f6a8616a7bf8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.248165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.250627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.250627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.250883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.251861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.256702 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.269335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 980/1972] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:08 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:08.269811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.281338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4df6-fd02-43ec-b0e8-984eba07e776 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.287956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.288428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.288884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.289140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.289524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.289980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.290397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:08.290814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.292971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.295630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:08.303912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 993/1973] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:08.304847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.324049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 981/1974] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:08.324252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e176c7-c741-4fac-bb31-144a6dd1dc57 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.324951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.331987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59702877-6f0d-4c2f-aad1-c5f109841a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.333301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59702877-6f0d-4c2f-aad1-c5f109841a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.334041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59702877-6f0d-4c2f-aad1-c5f109841a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.334280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59702877-6f0d-4c2f-aad1-c5f109841a7f admin admin] PATH_INFO: `/v3/projects/afe26a75aa3844a6926ec9fac8d90e08/users/9f399cb65ae34d51ae08623f1015fdaf/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.338245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59702877-6f0d-4c2f-aad1-c5f109841a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe26a75aa3844a6926ec9fac8d90e08, user_id=9f399cb65ae34d51ae08623f1015fdaf, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.341931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59702877-6f0d-4c2f-aad1-c5f109841a7f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.350691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429fbbb-a2ad-4924-ae71-71a75f1612b9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.369962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 994/1975] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:08 2022] PUT /identity/v3/projects/afe26a75aa3844a6926ec9fac8d90e08/users/9f399cb65ae34d51ae08623f1015fdaf/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:08.380736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.380736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.381099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.440844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] MFA Rules not processed for user `9f399cb65ae34d51ae08623f1015fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:08.442145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:08.477652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.479097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.479861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.480515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.481554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.484838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.538949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 982/1976] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:08 2022] POST /identity/v3/projects => generated 386 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:08.545775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.551628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 995/1977] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:08.652546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0695-a37a-4a58-bf26-adb033b35350 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.664818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.666004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.667401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.668053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.682542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.685549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.729997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.731064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 983/1978] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:08 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:08.735460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:08.743794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b5e7-76e3-47fe-a1a8-b6ebbcf1eea6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.753791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.754512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.755112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.755407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.756555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.758584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.780905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 996/1979] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:08 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:20:08.785892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.803653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e6e28-ebaa-4962-be51-98d6ffca20d5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.810242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e31939-bd56-4478-9f48-0dfaa519c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.811765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31939-bd56-4478-9f48-0dfaa519c10c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.812211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31939-bd56-4478-9f48-0dfaa519c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.812634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31939-bd56-4478-9f48-0dfaa519c10c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.813578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e31939-bd56-4478-9f48-0dfaa519c10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.815816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e31939-bd56-4478-9f48-0dfaa519c10c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.856269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 984/1980] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:08 2022] GET /identity/v3/roles => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:08.860769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:08.878236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a2edd-5fef-4097-9ddd-ec7b9cbc446e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:08.892651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:08.895674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:08.895971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:08.907311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] PATH_INFO: `/v3/projects/a59b52e6e4ce415395fc2a59add3223b/users/c7723582b9994e88a890ebc55f086eba/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:08.949365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59b52e6e4ce415395fc2a59add3223b, user_id=c7723582b9994e88a890ebc55f086eba, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:08.959999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:08.993151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 997/1981] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:08 2022] PUT /identity/v3/projects/a59b52e6e4ce415395fc2a59add3223b/users/c7723582b9994e88a890ebc55f086eba/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:08.999885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:09.000181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:09.000482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:09.057074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] MFA Rules not processed for user `c7723582b9994e88a890ebc55f086eba`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:09.060469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:09.134586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:09.177316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 985/1982] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:09.234535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:09.237880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:09.339429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53675d1-0985-4f6d-8546-1f104d04b0d5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:09.345730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:09.347499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:09.353276 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:09.353660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:09.375741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:09.377054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:09.390058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 998/1983] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:09.493826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:09.505805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318d90-dc5e-44b0-befb-ebf3ea5722e3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:09.512979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:09.514233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:09.514514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:09.516921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:09.525224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:09.636847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:09.639150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:09.657766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 986/1984] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:11.934942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:11.960125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66df8a-6c2d-4457-8408-f5d14d0b6ea1 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:11.972841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:11.973589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:11.973849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:11.974123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:11.977967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:12.102829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:12.105004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:12.118864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 999/1985] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:14.412268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:14.427921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56296-4067-4424-a3e9-d03a58081fab service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:14.439258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:14.440930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:14.442342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:14.443122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:14.452759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:14.586196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:14.588737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8d02-ec8c-4666-92fb-e17ea61f7070 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:14.617336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 987/1986] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:16.700245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:16.791643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b35d63-f5ef-4868-a4e0-10901d95c3c6 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:16.798478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:16.799532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:16.799818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:16.800253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] PATH_INFO: `/v3/users/c7723582b9994e88a890ebc55f086eba` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:16.803112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7723582b9994e88a890ebc55f086eba)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:16.806022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:16.813091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:16.925366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7723582b9994e88a890ebc55f086eba'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:16.947910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7723582b9994e88a890ebc55f086eba'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:16.948741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7723582b9994e88a890ebc55f086eba'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:16.962801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7723582b9994e88a890ebc55f086eba'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:16.963577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7723582b9994e88a890ebc55f086eba'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:16.998352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638686a-8127-4365-93cb-761ff834646c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:17.001819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638686a-8127-4365-93cb-761ff834646c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:17.002518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638686a-8127-4365-93cb-761ff834646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:17.005089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1000/1987] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:16 2022] DELETE /identity/v3/users/c7723582b9994e88a890ebc55f086eba => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:17.032679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5638686a-8127-4365-93cb-761ff834646c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:17.035545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5638686a-8127-4365-93cb-761ff834646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:17.128555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 988/1988] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:17.142700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:17.145207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:17.243853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1a89-473d-493e-a959-8073c3b45ade admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:17.251405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:17.252811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:17.253452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:17.254113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:17.268810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:17.270340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:17.284163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1001/1989] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:17.658830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638686a-8127-4365-93cb-761ff834646c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:17.660553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5638686a-8127-4365-93cb-761ff834646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:17.678390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:17.680042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:17.680326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638686a-8127-4365-93cb-761ff834646c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:17.689024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:17.690055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:17.690338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:17.690609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] PATH_INFO: `/v3/projects/a59b52e6e4ce415395fc2a59add3223b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:17.691901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59b52e6e4ce415395fc2a59add3223b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:17.694056 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:17.705932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499343-ef7b-4ed6-86c1-16ed54ea24a8 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:17.717213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:17.718172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:17.718403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:17.718674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] PATH_INFO: `/v3/users/084c6afa3d2d4200a206c46427d915e5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:17.719931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=084c6afa3d2d4200a206c46427d915e5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:17.727007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:17.745742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:17.810857 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59b52e6e4ce415395fc2a59add3223b', 'request_id': 'req-9b44090f-144f-43d4-89be-a993f0581c1d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.825578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59b52e6e4ce415395fc2a59add3223b', 'request_id': 'req-9b44090f-144f-43d4-89be-a993f0581c1d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.832567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084c6afa3d2d4200a206c46427d915e5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.842537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59b52e6e4ce415395fc2a59add3223b', 'request_id': 'req-9b44090f-144f-43d4-89be-a993f0581c1d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.851133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084c6afa3d2d4200a206c46427d915e5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.852306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084c6afa3d2d4200a206c46427d915e5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.863108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] The token cache is being invalidate because project a59b52e6e4ce415395fc2a59add3223b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:17.863108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.863981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.865759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084c6afa3d2d4200a206c46427d915e5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.866950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71783687-c897-41bc-8b06-2cae45fe04bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084c6afa3d2d4200a206c46427d915e5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:17.867847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 989/1990] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:17 2022] DELETE /identity/v3/projects/a59b52e6e4ce415395fc2a59add3223b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:17.869385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:17.872359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:17.887595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:17.898104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1002/1991] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:17 2022] DELETE /identity/v3/users/084c6afa3d2d4200a206c46427d915e5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:17.900182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8617-05e8-4136-841a-18ed073cc30b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:17.901627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8617-05e8-4136-841a-18ed073cc30b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:17.902366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8617-05e8-4136-841a-18ed073cc30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:17.941174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d9aa8617-05e8-4136-841a-18ed073cc30b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:17.945141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d9aa8617-05e8-4136-841a-18ed073cc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:17.964136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44090f-144f-43d4-89be-a993f0581c1d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.027401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.028866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.029370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.030008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.032292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.052397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1003/1992] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:18.052832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15fed-d9d7-4eae-89b7-e68e6b0fd8d7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.053514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15fed-d9d7-4eae-89b7-e68e6b0fd8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.054102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15fed-d9d7-4eae-89b7-e68e6b0fd8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.099180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5ba15fed-d9d7-4eae-89b7-e68e6b0fd8d7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:18.099180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5ba15fed-d9d7-4eae-89b7-e68e6b0fd8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.109801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1004/1993] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:18.111458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.111877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.112438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.174857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:18.176317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.177106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.180518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.197477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1005/1994] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:18.198430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.200553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 990/1995] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:18.200900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.203341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.206710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.222464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994bb76-d6a6-49e8-9723-d8a903904da9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.247268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:18.247534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.249560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.249817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.250061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] PATH_INFO: `/v3/users/a49a4d4fd9ff4859b8787ee8609f5ae1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.251772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49a4d4fd9ff4859b8787ee8609f5ae1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.255962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.358398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05a1a3-ee41-4623-b40f-bd51aa06799c service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.364357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.365261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.365721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.366131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.381504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.398280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.421594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 991/1996] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:18.421594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.437039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f5403-fdca-4891-b677-894ac33daae8 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.452742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49a4d4fd9ff4859b8787ee8609f5ae1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:18.460901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.462267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.462765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.463003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.463877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:18.464070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.466710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.482076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49a4d4fd9ff4859b8787ee8609f5ae1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:18.482875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49a4d4fd9ff4859b8787ee8609f5ae1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:18.497058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49a4d4fd9ff4859b8787ee8609f5ae1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:18.497864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-be91193e-b917-4211-b2a4-43ce4d192227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49a4d4fd9ff4859b8787ee8609f5ae1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:18.508998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 992/1997] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:18.515491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.518486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.529474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1006/1998] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:18 2022] DELETE /identity/v3/users/a49a4d4fd9ff4859b8787ee8609f5ae1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:18.532042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.532340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.532625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.568176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174994-9402-4ad0-b128-6f33bbd40995 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.597470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:18.598762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.704571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.706294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.706783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.707240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.708200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.711380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.726720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:18.739986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1007/1999] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:18.768380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.770119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.778513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 993/2000] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:18 2022] POST /identity/v3/projects => generated 376 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:18.779511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.851162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d61e8-fc35-4e02-88cf-4edf0d9534ce None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.898858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c72a-05ae-4ffd-9f00-5b904e903467 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.905069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.906420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.906863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.907297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.908552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.913516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.934490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.935951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.936422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.936685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:18.946760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 994/2001] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:18 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:18.948140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.950868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:18.952596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:18.954202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:18.967968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1008/2002] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:18.968975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:18.978516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:18.984424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080890dd-7cd4-417b-b994-5442606295ba service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:18.995554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:18.997819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:18.998744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:18.999606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.001220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.010742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.030746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1009/2003] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:18 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:19.037318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.060171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59e75b-c2e3-4f1d-bfd3-62e9200162d3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.069327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.070300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.070579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.070864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.071800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.075070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.088083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa66b-901c-4a4c-b384-cea3b90a41fb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.088850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1010/2004] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:19 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:19.089853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.094714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:19.098930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f399cb65ae34d51ae08623f1015fdaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe26a75aa3844a6926ec9fac8d90e08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.099720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.100065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.100908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.101244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:19.101565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.103360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.119872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 995/2005] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:19.119872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.132772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822206b-f837-482f-9f49-883ffb2a654a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.135700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0693e6-c5e5-4b57-bbfb-d83f7bccfcc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.147952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.149922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.150126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.150579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.151513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.151863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] PATH_INFO: `/v3/projects/a4ff507beacf469a8555baa5b2520936` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.152039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.152519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] PATH_INFO: `/v3/projects/6e5c94976fca408988a21baa61370dfb/users/e02862950b884d0c89e2b1b177ed5253/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.155017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ff507beacf469a8555baa5b2520936)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.160538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.187448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5c94976fca408988a21baa61370dfb, user_id=e02862950b884d0c89e2b1b177ed5253, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.191124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.217990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 996/2006] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:19 2022] PUT /identity/v3/projects/6e5c94976fca408988a21baa61370dfb/users/e02862950b884d0c89e2b1b177ed5253/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:19.219676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.240111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ff507beacf469a8555baa5b2520936', 'request_id': 'req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:19.254061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ff507beacf469a8555baa5b2520936', 'request_id': 'req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:19.262805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ff507beacf469a8555baa5b2520936', 'request_id': 'req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:19.284587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] The token cache is being invalidate because project a4ff507beacf469a8555baa5b2520936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:19.285753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:19.287274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d58b3e8d-ec5b-49a1-a8ab-fe1305fffc6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:19.292240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1011/2007] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:19 2022] DELETE /identity/v3/projects/a4ff507beacf469a8555baa5b2520936 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:19.292240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.292240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.293481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.341026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] MFA Rules not processed for user `e02862950b884d0c89e2b1b177ed5253`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:19.342322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:19.349589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:19.383743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccab0f-6a37-4142-8c98-96fbad61a565 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.525219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1012/2008] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:19.527260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.529631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:19.586988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f399cb65ae34d51ae08623f1015fdaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe26a75aa3844a6926ec9fac8d90e08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.586988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.586988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.587550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.587550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.587550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.689985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 997/2009] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:19 2022] POST /identity/v3/projects => generated 355 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:19.690860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.698362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:19.747288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:19.788158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee1ec0-c03d-4dc0-b64c-8410542b36ba None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.856396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666ec74-0341-45ed-b940-5838a27fe56c tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:19.871713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.872502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.872880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.873085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.873827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.875921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.918125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:19.919175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:19.919624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:19.920044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] PATH_INFO: `/v3/users/bd68bb3262e44fa2a12cb4a95962789a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:19.922423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd68bb3262e44fa2a12cb4a95962789a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:19.924874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:19.957958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 998/2010] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:19 2022] POST /identity/v3/projects => generated 374 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:19.962434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:19.965023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.019541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd68bb3262e44fa2a12cb4a95962789a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.036442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:20.053636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd68bb3262e44fa2a12cb4a95962789a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.054625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd68bb3262e44fa2a12cb4a95962789a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.071742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08fe70-dd54-44e1-9b52-1ff040e8414e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.085412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.089011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.089829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.089829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] PATH_INFO: `/v3/projects/1e9f6674b01d455fa02eadd95970b7cf` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:20.092092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd68bb3262e44fa2a12cb4a95962789a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.092249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9f6674b01d455fa02eadd95970b7cf)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:20.093856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd68bb3262e44fa2a12cb4a95962789a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.094917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:20.116025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1013/2011] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:19 2022] DELETE /identity/v3/users/bd68bb3262e44fa2a12cb4a95962789a => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:20.117593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.120796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.183297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9f6674b01d455fa02eadd95970b7cf', 'request_id': 'req-52102ef9-b061-43ed-8b83-96adeb43fe37'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.210426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9f6674b01d455fa02eadd95970b7cf', 'request_id': 'req-52102ef9-b061-43ed-8b83-96adeb43fe37'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.225655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9f6674b01d455fa02eadd95970b7cf', 'request_id': 'req-52102ef9-b061-43ed-8b83-96adeb43fe37'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.245876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28dbe5-0c25-409c-9316-86eca8e006f0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.258950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] The token cache is being invalidate because project 1e9f6674b01d455fa02eadd95970b7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:20.261051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.264850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.271208 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 999/2012] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:19 2022] DELETE /identity/v3/projects/1e9f6674b01d455fa02eadd95970b7cf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:20.272446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.276146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.372339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:20.384031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f399cb65ae34d51ae08623f1015fdaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe26a75aa3844a6926ec9fac8d90e08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.384981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.385443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.385829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:20.387385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:20.388242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:20.390121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:20.414373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1014/2013] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:20.416233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.430427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52102ef9-b061-43ed-8b83-96adeb43fe37 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.432697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.437020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.437810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.438092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.438903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:20.439370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:20.443793 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:20.489853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aade0f-12c8-4d43-a387-34002dceddc7 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.494596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1000/2014] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:20 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:20.497105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.500680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.501977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.502280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.502564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] PATH_INFO: `/v3/users/58cb004dfe2843a29feec903c45e0444` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:20.503880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58cb004dfe2843a29feec903c45e0444)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:20.506132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:20.511887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d22fbc-c214-475f-b471-480c2a0e267e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.528027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.529299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.529654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.530309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:20.531752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:20.534747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:20.551128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1001/2015] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:20 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:20.552278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.555549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.577224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ade3d-b405-4918-b1f5-7c71d39f8e9b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.586698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f399cb65ae34d51ae08623f1015fdaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe26a75aa3844a6926ec9fac8d90e08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.589455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.590311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.590967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] PATH_INFO: `/v3/projects/93a1c3ecb08b45eda9d62cfe7ea2e816` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:20.591455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58cb004dfe2843a29feec903c45e0444'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.595660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=93a1c3ecb08b45eda9d62cfe7ea2e816)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:20.602510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:20.611074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58cb004dfe2843a29feec903c45e0444'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.611807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58cb004dfe2843a29feec903c45e0444'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.617470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:20.630012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58cb004dfe2843a29feec903c45e0444'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.630977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58cb004dfe2843a29feec903c45e0444'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.666641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1015/2016] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:20 2022] DELETE /identity/v3/users/58cb004dfe2843a29feec903c45e0444 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:20.667611 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.669881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.761491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a1c3ecb08b45eda9d62cfe7ea2e816', 'request_id': 'req-3501becd-a4c4-438f-983d-a3627e772369'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.789370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a1c3ecb08b45eda9d62cfe7ea2e816', 'request_id': 'req-3501becd-a4c4-438f-983d-a3627e772369'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.802478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a1c3ecb08b45eda9d62cfe7ea2e816', 'request_id': 'req-3501becd-a4c4-438f-983d-a3627e772369'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.809264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ba126-c35c-4d0d-b65a-c6e4270abbd6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:20.841600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] The token cache is being invalidate because project 93a1c3ecb08b45eda9d62cfe7ea2e816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:20.841935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.843038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:20.850908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1002/2017] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:20 2022] DELETE /identity/v3/projects/93a1c3ecb08b45eda9d62cfe7ea2e816 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:20.850908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:20.876628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:20.985647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:20.987452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:20.987788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:20.988511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] PATH_INFO: `/v3/projects/bbba3b14abf446419701f0b032a44ed0/users/43a2fb8a1a8d4aca9edf6682572df409/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:21.028358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbba3b14abf446419701f0b032a44ed0, user_id=43a2fb8a1a8d4aca9edf6682572df409, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:21.034162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:21.051310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1016/2018] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:20 2022] PUT /identity/v3/projects/bbba3b14abf446419701f0b032a44ed0/users/43a2fb8a1a8d4aca9edf6682572df409/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:21.057862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:21.060634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:21.077982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501becd-a4c4-438f-983d-a3627e772369 tempest-VolumeQuotaClassesTest-378275358 tempest-VolumeQuotaClassesTest-378275358-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:21.171393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fead1d5-46f9-4ca3-9c7c-c78be4591944 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:21.198227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:21.203447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:21.205737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:21.206331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:21.208258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:21.215833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:21.240995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:21.244286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1017/2019] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:21 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:21.249051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:21.274832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41faca3-0925-493d-99a0-66a80b89df41 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:21.287964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:21.299057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:21.301559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:21.302016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:21.302310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] PATH_INFO: `/v3/projects/bbba3b14abf446419701f0b032a44ed0/users/43a2fb8a1a8d4aca9edf6682572df409/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:21.302515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:21.303015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:21.304508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] PATH_INFO: `/v3/projects/ccab86c9649c42b594471675449a9bb2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:21.307076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbba3b14abf446419701f0b032a44ed0, user_id=43a2fb8a1a8d4aca9edf6682572df409, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:21.307976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccab86c9649c42b594471675449a9bb2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:21.315394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:21.321844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:21.345015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:21.372259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1018/2020] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:21 2022] PUT /identity/v3/projects/bbba3b14abf446419701f0b032a44ed0/users/43a2fb8a1a8d4aca9edf6682572df409/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:21.375532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:21.385226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:21.494168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccab86c9649c42b594471675449a9bb2', 'request_id': 'req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.521420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccab86c9649c42b594471675449a9bb2', 'request_id': 'req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.529544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccab86c9649c42b594471675449a9bb2', 'request_id': 'req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.562548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] The token cache is being invalidate because project ccab86c9649c42b594471675449a9bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:21.562853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.567278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-72cf36ec-edf9-489e-a96b-86e9cf37fe6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.569419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1003/2021] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:20 2022] DELETE /identity/v3/projects/ccab86c9649c42b594471675449a9bb2 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:21.570805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:21.571114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:21.571392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:21.618480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a2204-fe9f-4c68-be63-a700f8af1c41 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:21.679998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] MFA Rules not processed for user `43a2fb8a1a8d4aca9edf6682572df409`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:21.685511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:21.754278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:21.755386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:21.756625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:21.757022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] PATH_INFO: `/v3/projects/bbb873bdb8354ff48f04dca188509228` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:21.759363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb873bdb8354ff48f04dca188509228)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:21.762293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:21.866983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1004/2022] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:21.868457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:21.870993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:21.875049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb873bdb8354ff48f04dca188509228', 'request_id': 'req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.888239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b547-120b-43c7-8a4d-6f1c0730a727 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:21.899146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb873bdb8354ff48f04dca188509228', 'request_id': 'req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.919282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb873bdb8354ff48f04dca188509228', 'request_id': 'req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.952497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] The token cache is being invalidate because project bbb873bdb8354ff48f04dca188509228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:21.954353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.955477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:21.974358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1019/2023] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:21 2022] DELETE /identity/v3/projects/bbb873bdb8354ff48f04dca188509228 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:21.975474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:21.978302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:21.996515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:22.028231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.028526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.028810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] PATH_INFO: `/v3/users/1f71343905e8440dbc94d35fb2b106db` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.036859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f71343905e8440dbc94d35fb2b106db)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:22.040416 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:22.043395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:22.055809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:22.107207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98654-3ba2-44da-b9da-216dfa0a7ecc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:22.120355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:22.128432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.128659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.129528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] PATH_INFO: `/v3/users/c184ea9211694aae82ef10d37ec453f9` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.131663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c184ea9211694aae82ef10d37ec453f9)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:22.146690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:22.183299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f71343905e8440dbc94d35fb2b106db'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.184057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f71343905e8440dbc94d35fb2b106db'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.184929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f71343905e8440dbc94d35fb2b106db'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.219768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f71343905e8440dbc94d35fb2b106db'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.234397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f71343905e8440dbc94d35fb2b106db'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.264492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1005/2024] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:21 2022] DELETE /identity/v3/users/1f71343905e8440dbc94d35fb2b106db => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:22.266233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:22.268915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.276415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c184ea9211694aae82ef10d37ec453f9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.313466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c184ea9211694aae82ef10d37ec453f9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.316040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c184ea9211694aae82ef10d37ec453f9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.344322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c184ea9211694aae82ef10d37ec453f9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.345036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c184ea9211694aae82ef10d37ec453f9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.400295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1020/2025] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:21 2022] DELETE /identity/v3/users/c184ea9211694aae82ef10d37ec453f9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:22.401591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:22.403326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.431519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da99743-5e7c-49cf-85ae-c5389f088da9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:22.545454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:22.546284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.546755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.547080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] PATH_INFO: `/v3/users/56965452a7ad42e580239d11bf46944f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.548136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e1a1-5f72-4f3d-8742-df7c48b12068 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:22.549195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] RBAC: Authorizing `identity:delete_user(user_id=56965452a7ad42e580239d11bf46944f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:22.551343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:22.552368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:22.553401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.553988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.553988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.557049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.594624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:22.635928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56965452a7ad42e580239d11bf46944f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.636874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56965452a7ad42e580239d11bf46944f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.637945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56965452a7ad42e580239d11bf46944f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.650159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:22.651660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ed278-75a9-484a-a649-a8cfa67f9176 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:22.665341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1021/2026] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:22.667298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.667752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.668035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.675415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56965452a7ad42e580239d11bf46944f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.691273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d513076b-ef27-4acc-821f-3d95f9ae38be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56965452a7ad42e580239d11bf46944f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.701993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:22.703542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.715392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1006/2027] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:22 2022] DELETE /identity/v3/users/56965452a7ad42e580239d11bf46944f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:22.715392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f707-16ae-4027-99b9-fe769267e903 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.715392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f707-16ae-4027-99b9-fe769267e903 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.715392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f707-16ae-4027-99b9-fe769267e903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.717031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1022/2028] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:22.718054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:22.721252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.735028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:22.740486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835cec-12a2-4884-93a8-e0ab79986d8e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:22.751616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a09f707-16ae-4027-99b9-fe769267e903 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:22.753384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a09f707-16ae-4027-99b9-fe769267e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.832908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:22.834694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.834901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.836275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] PATH_INFO: `/v3/users/ae9d01db3b9c488a9e16da9f8663281e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.837973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9d01db3b9c488a9e16da9f8663281e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:22.840485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:22.881363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1007/2029] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:22.882969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2cc71-df1f-4244-8387-cd49901f2020 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.883284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2cc71-df1f-4244-8387-cd49901f2020 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.883553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2cc71-df1f-4244-8387-cd49901f2020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.912642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2de2cc71-df1f-4244-8387-cd49901f2020 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:22.913884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2de2cc71-df1f-4244-8387-cd49901f2020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.922081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1008/2030] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:22.923474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:22.924169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:22.924667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:22.933056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9d01db3b9c488a9e16da9f8663281e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.954000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:22.955569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.957012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9d01db3b9c488a9e16da9f8663281e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.958616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9d01db3b9c488a9e16da9f8663281e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.968891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1009/2031] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:22.970022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:22.973937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:22.974271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9d01db3b9c488a9e16da9f8663281e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.975685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9d01db3b9c488a9e16da9f8663281e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:22.999846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1023/2032] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:22 2022] DELETE /identity/v3/users/ae9d01db3b9c488a9e16da9f8663281e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:22.999846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.000193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7ec23-c150-44ad-a376-725cc244f9ad None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.000384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.109305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c881-1e86-42ea-9e65-2f3cc4d0e8a4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.115724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.117464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.118510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.119174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.123153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.138468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.140561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.140923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.141503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] PATH_INFO: `/v3/projects/f06c313b138247e6b07b4c82ead1b7da` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.143596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06c313b138247e6b07b4c82ead1b7da)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.147573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.219246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:23.260092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:23.276563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06c313b138247e6b07b4c82ead1b7da', 'request_id': 'req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.279164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.281917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.292156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06c313b138247e6b07b4c82ead1b7da', 'request_id': 'req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.301368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1024/2033] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:23.303577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.303727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06c313b138247e6b07b4c82ead1b7da', 'request_id': 'req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.315538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7aae-1211-4ccc-80ac-1c2ecd33dc68 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.320035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] The token cache is being invalidate because project f06c313b138247e6b07b4c82ead1b7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:23.320332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.322076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.323028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1010/2034] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:22 2022] DELETE /identity/v3/projects/f06c313b138247e6b07b4c82ead1b7da => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:23.324740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.325830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.437693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.438410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.438913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.439371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.441769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.450715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7347e-1572-45a4-ad4a-9c46d6c2c6af admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.457898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.458606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.458810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.458948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.459167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.460012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:23.460313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260ec47-0fe7-4a53-aaf8-a9f9e5447830 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.460754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.462990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.479487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1025/2035] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:23.481187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.482538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.482538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.484784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1011/2036] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:23.486535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.490489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.507900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:23.509287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.510592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b6783-31c5-46ed-89a2-6cb4359446d9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.517136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.518065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.518962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.518962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] PATH_INFO: `/v3/projects/cf96adf639284e72aa9c8bec44aa199f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.519532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1026/2037] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:23.520456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.529607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf96adf639284e72aa9c8bec44aa199f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.532836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5401-4638-4764-9558-7fa1406fd452 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.533045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.538163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69a70e-5e1d-41f1-8615-2d5b338e047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.538704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69a70e-5e1d-41f1-8615-2d5b338e047a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.538989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69a70e-5e1d-41f1-8615-2d5b338e047a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.539267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69a70e-5e1d-41f1-8615-2d5b338e047a admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.539979 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69a70e-5e1d-41f1-8615-2d5b338e047a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.542179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69a70e-5e1d-41f1-8615-2d5b338e047a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.617319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1027/2038] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:23 2022] POST /identity/v3/projects => generated 372 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:23.617319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e8292-dd0a-40e1-bd0d-e13bf021d283 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.617319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e8292-dd0a-40e1-bd0d-e13bf021d283 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.617319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e8292-dd0a-40e1-bd0d-e13bf021d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.629656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf96adf639284e72aa9c8bec44aa199f', 'request_id': 'req-0af9a768-a05f-410e-bda4-6f41dd1cffcf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.646552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf96adf639284e72aa9c8bec44aa199f', 'request_id': 'req-0af9a768-a05f-410e-bda4-6f41dd1cffcf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.654476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-549e8292-dd0a-40e1-bd0d-e13bf021d283 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:23.657602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-549e8292-dd0a-40e1-bd0d-e13bf021d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.661632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf96adf639284e72aa9c8bec44aa199f', 'request_id': 'req-0af9a768-a05f-410e-bda4-6f41dd1cffcf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.706512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] The token cache is being invalidate because project cf96adf639284e72aa9c8bec44aa199f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:23.707337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.708403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.713407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1012/2039] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:23 2022] DELETE /identity/v3/projects/cf96adf639284e72aa9c8bec44aa199f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:23.714913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.720455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.794484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1028/2040] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:23.799311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.799606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.799861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.812442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:23.825334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:23.826407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.838222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1029/2041] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:23.839256 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.840931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:23.854434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc90d4-e7d6-4f36-b08c-1c394a6066c6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.859393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.860580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.860914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.861801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] PATH_INFO: `/v3/projects/49b989056ff9419189c995545ab98106` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.862834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b989056ff9419189c995545ab98106)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.865054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.872389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9a768-a05f-410e-bda4-6f41dd1cffcf admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.878776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:23.879483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:23.879764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:23.880037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:23.880747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:23.883020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:23.912723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1013/2042] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:23 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:23.913711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:23.928356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9d13-e139-4f29-b9ae-811f3e52f5f0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:23.932724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:23.945801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b989056ff9419189c995545ab98106', 'request_id': 'req-adaa26d9-25e4-4f12-a252-7244c00622d6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.956466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b989056ff9419189c995545ab98106', 'request_id': 'req-adaa26d9-25e4-4f12-a252-7244c00622d6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.981388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b989056ff9419189c995545ab98106', 'request_id': 'req-adaa26d9-25e4-4f12-a252-7244c00622d6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:23.999266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] The token cache is being invalidate because project 49b989056ff9419189c995545ab98106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:23.999569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.000385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-adaa26d9-25e4-4f12-a252-7244c00622d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.003270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1030/2043] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:23 2022] DELETE /identity/v3/projects/49b989056ff9419189c995545ab98106 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:24.004659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.004950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.005399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.026555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.027239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.027556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.027838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.031457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:24.031457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.031702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:24.031702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.034940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.044154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1031/2044] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:24.045034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.048169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1014/2045] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:24.049898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.051933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.052689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.067313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f65118-6397-4258-bb47-834d4bfd8cb3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.077506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.077725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91311b8-a3c3-4987-afff-91603caba365 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.077898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.077898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.077898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] PATH_INFO: `/v3/projects/120be2c4a90647c28d97db19de5ab412` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.077898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120be2c4a90647c28d97db19de5ab412)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.079796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.084404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.085162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.085775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.086061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.087149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.089168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.103620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1015/2046] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:24.104580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.107179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.120891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72679d0c-251e-4944-a54e-7c54d1eebc6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.126264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.127507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.128068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.128567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] PATH_INFO: `/v3/users/9f399cb65ae34d51ae08623f1015fdaf` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.130861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f399cb65ae34d51ae08623f1015fdaf)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.134198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.161902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120be2c4a90647c28d97db19de5ab412', 'request_id': 'req-6a886056-da38-4434-9167-032a1770ad50'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.171671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120be2c4a90647c28d97db19de5ab412', 'request_id': 'req-6a886056-da38-4434-9167-032a1770ad50'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.179527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120be2c4a90647c28d97db19de5ab412', 'request_id': 'req-6a886056-da38-4434-9167-032a1770ad50'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.193396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] The token cache is being invalidate because project 120be2c4a90647c28d97db19de5ab412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:24.197840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.197840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.197840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1032/2047] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:24 2022] DELETE /identity/v3/projects/120be2c4a90647c28d97db19de5ab412 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:24.197840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.199116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.205089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f399cb65ae34d51ae08623f1015fdaf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.205811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f399cb65ae34d51ae08623f1015fdaf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.206540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f399cb65ae34d51ae08623f1015fdaf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.227769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f399cb65ae34d51ae08623f1015fdaf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.238747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f399cb65ae34d51ae08623f1015fdaf'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.258551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1016/2048] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:24 2022] DELETE /identity/v3/users/9f399cb65ae34d51ae08623f1015fdaf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:24.259633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.261284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.314742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:24.325386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a886056-da38-4434-9167-032a1770ad50 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.379842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22154b-0825-48b4-88ef-db5c58194e03 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.385672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.387177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.387442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.387580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.389477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.391300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.444466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:24.446128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1017/2049] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:24 2022] POST /identity/v3/projects => generated 408 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:24.448292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.452539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.480124 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.481413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.482142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.482658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.483839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:24.484386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.487239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.519167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1033/2050] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:24.519167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.519628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.541255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475870e1-d23c-463a-afe2-4c7b51555ea2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.627894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b559d7-6b92-43c4-983f-72646feab8c8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.630296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.631620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.636875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.636875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.636875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.639996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.650302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.651937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.652240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.655037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] PATH_INFO: `/v3/users/0f3a4fc0e4b340a8bcf16f54c9774db3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.655037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3a4fc0e4b340a8bcf16f54c9774db3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.656349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.657643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1018/2051] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:24.661069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.679999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbca190-02ab-4b6d-b6e9-addf5df91636 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.687010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.688158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.688804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.689509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.692211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.696026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.726616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1019/2052] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:24 2022] POST /identity/v3/users => generated 305 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:24.727888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.730037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.748642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4478-ba77-4396-b74a-945c6143646f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.749090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3a4fc0e4b340a8bcf16f54c9774db3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.766908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.768247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.770328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.770771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.772243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.776044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.782542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3a4fc0e4b340a8bcf16f54c9774db3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.784154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3a4fc0e4b340a8bcf16f54c9774db3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.811075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3a4fc0e4b340a8bcf16f54c9774db3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.812020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3a4fc0e4b340a8bcf16f54c9774db3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:24.828542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1020/2053] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:24 2022] POST /identity/v3/projects => generated 394 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:24.830091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.830230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1034/2054] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:24 2022] DELETE /identity/v3/users/0f3a4fc0e4b340a8bcf16f54c9774db3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:24.831372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:24.832627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.834293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.971831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd71e2e-6e44-4882-adb4-c1bc9301d341 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.976167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e7ff4-28a5-498f-b464-db7b7c81455c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:24.978469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.979122 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.979404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.979673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.980515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:24.982493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:24.984852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:24.985370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.985730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.985966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:24.986327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] PATH_INFO: `/v3/projects/f80c07e08c084d93a7020d4ab0b4eef7/users/e81883bdbd1645608248b2b8d9140479/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.000123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1035/2055] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:25.000927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.006567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.009266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:25.027234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80c07e08c084d93a7020d4ab0b4eef7, user_id=e81883bdbd1645608248b2b8d9140479, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.030024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.039618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa123-8158-4045-9a7e-b8c7107b5ce2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.054468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1021/2056] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:24 2022] PUT /identity/v3/projects/f80c07e08c084d93a7020d4ab0b4eef7/users/e81883bdbd1645608248b2b8d9140479/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:25.055755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.058317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.152973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.154097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.154496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.154809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] PATH_INFO: `/v3/projects/afe26a75aa3844a6926ec9fac8d90e08` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.156364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe26a75aa3844a6926ec9fac8d90e08)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.158517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.165483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c19f-a050-4ec9-9f34-3377bea31519 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.175103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.175828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.176114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.179974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.180743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.182962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.218576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1022/2057] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:25 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:25.218576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.229687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c440bc2-6908-460c-b9a1-c508813f579c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.257516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe26a75aa3844a6926ec9fac8d90e08', 'request_id': 'req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.277864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe26a75aa3844a6926ec9fac8d90e08', 'request_id': 'req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.292425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe26a75aa3844a6926ec9fac8d90e08', 'request_id': 'req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.314225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] The token cache is being invalidate because project afe26a75aa3844a6926ec9fac8d90e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:25.315249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.316009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-632a9ef9-a8a5-48de-ad6b-2c4346c5791b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.317832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1036/2058] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:24 2022] DELETE /identity/v3/projects/afe26a75aa3844a6926ec9fac8d90e08 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:25.319220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64a3b-c623-4e96-8b9f-9d4bbeaebb0b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.319630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64a3b-c623-4e96-8b9f-9d4bbeaebb0b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.320091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64a3b-c623-4e96-8b9f-9d4bbeaebb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.335124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.336635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.337184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.337932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.338700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.340574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.356900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1023/2059] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:25 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:25.357837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.362213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.363744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bbd64a3b-c623-4e96-8b9f-9d4bbeaebb0b None None] MFA Rules not processed for user `e81883bdbd1645608248b2b8d9140479`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:25.364982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bbd64a3b-c623-4e96-8b9f-9d4bbeaebb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.379773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1658-ec00-4465-9e17-556219fb9827 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.387264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.387968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.388252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.388551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.389313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.390978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.411600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1024/2060] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:25 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:25.412930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.414735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.428902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35451b-7655-46d3-941c-4767fa7f0f6b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.434477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.437095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.437095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.437095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] PATH_INFO: `/v3/projects/7a0048e61ed349a5b24c65dab0a7a1ae` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.438170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0048e61ed349a5b24c65dab0a7a1ae)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.440259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.467982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1037/2061] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:25.473178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.474172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.474172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.499887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:25.501074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.510738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0048e61ed349a5b24c65dab0a7a1ae', 'request_id': 'req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.520240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0048e61ed349a5b24c65dab0a7a1ae', 'request_id': 'req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.523338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:25.528727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:25.528925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0048e61ed349a5b24c65dab0a7a1ae', 'request_id': 'req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.546618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] The token cache is being invalidate because project 7a0048e61ed349a5b24c65dab0a7a1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:25.546891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.547532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:25.549409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1025/2062] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:25 2022] DELETE /identity/v3/projects/7a0048e61ed349a5b24c65dab0a7a1ae => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:25.550173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.551545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.592039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1038/2063] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:25.592930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.594316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.610523 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a5f8c-e2d4-4c41-b75e-5e20855d7a20 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.618173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.619080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.619366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.619646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.620400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.622103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.640274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1039/2064] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:25 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:25.640274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.640445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e09c55-7ec5-47b1-8b2e-b0be53d29c86 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.640538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.643964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ced88-91d7-4dca-a77c-fff0375ea2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.645269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ced88-91d7-4dca-a77c-fff0375ea2db admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.645665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ced88-91d7-4dca-a77c-fff0375ea2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.646047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ced88-91d7-4dca-a77c-fff0375ea2db admin admin] PATH_INFO: `/v3/projects/bc0d319da8a047f0b3070814810bace9/users/8bb03080bb91456d98510713c1a1af1f/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.664722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ced88-91d7-4dca-a77c-fff0375ea2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0d319da8a047f0b3070814810bace9, user_id=8bb03080bb91456d98510713c1a1af1f, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.667647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ced88-91d7-4dca-a77c-fff0375ea2db admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.690379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1026/2065] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:25 2022] PUT /identity/v3/projects/bc0d319da8a047f0b3070814810bace9/users/8bb03080bb91456d98510713c1a1af1f/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:25.692178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f044ff-926c-4a95-9b8f-ac1dde71f91d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.692467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f044ff-926c-4a95-9b8f-ac1dde71f91d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.692740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f044ff-926c-4a95-9b8f-ac1dde71f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.717677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-14f044ff-926c-4a95-9b8f-ac1dde71f91d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:25.718949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-14f044ff-926c-4a95-9b8f-ac1dde71f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.759248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da4c76-e647-4c0f-8a06-4090a2a9d6c9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.785692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1027/2066] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:25.787600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.787995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.788373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.810276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:25.811520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.818553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.819283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.819564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.819839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.822028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.829345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1028/2067] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:25.829345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.846615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39253-21ab-42d4-9bba-66fc7efff2c1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:25.856547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:25.858275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.858776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.859269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] PATH_INFO: `/v3/projects/3ad3d0f1e92d4d92bb12ba8505a0e779/users/5a1a910de31044ab9c8dcfb2bb4651c6/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.883929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad3d0f1e92d4d92bb12ba8505a0e779, user_id=5a1a910de31044ab9c8dcfb2bb4651c6, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.886720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.904578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1029/2068] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:25 2022] PUT /identity/v3/projects/3ad3d0f1e92d4d92bb12ba8505a0e779/users/5a1a910de31044ab9c8dcfb2bb4651c6/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:25.909326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:25.911102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.912767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:25.914429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f4ce9-88cb-4bbb-864b-3f3128b90593 service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:25.925396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:25.926027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1040/2069] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:25.928081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4f4-9fe9-4140-a32a-a05809a8bda3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:25.928371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4f4-9fe9-4140-a32a-a05809a8bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:25.928657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4f4-9fe9-4140-a32a-a05809a8bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:25.970087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9036f4f4-9fe9-4140-a32a-a05809a8bda3 None None] MFA Rules not processed for user `8bb03080bb91456d98510713c1a1af1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:25.971738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9036f4f4-9fe9-4140-a32a-a05809a8bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:25.984172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:26.023316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702468-72a3-4132-8487-a5ee465976d7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.029894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.030876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.031235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.031514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] PATH_INFO: `/v3/users/e02862950b884d0c89e2b1b177ed5253` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.033581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02862950b884d0c89e2b1b177ed5253)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.035202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.092726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1041/2070] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:26.094148 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.094466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.094763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.107029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02862950b884d0c89e2b1b177ed5253'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:26.107639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02862950b884d0c89e2b1b177ed5253'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:26.109371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02862950b884d0c89e2b1b177ed5253'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:26.120334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:26.121622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:26.129659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02862950b884d0c89e2b1b177ed5253'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:26.132864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1042/2071] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:26.137075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.139518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:26.147561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c275bfd5-85da-4c66-a6e8-1219246c400b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02862950b884d0c89e2b1b177ed5253'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:26.155388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f7766-a3d9-4fc3-a393-3a27bb37644c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.162212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.162942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.163222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.163500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.164244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:26.164573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.166380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.170131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1030/2072] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:25 2022] DELETE /identity/v3/users/e02862950b884d0c89e2b1b177ed5253 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:26.173274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.173274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.173274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.182849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1043/2073] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:26.183680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.187683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:26.202908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dbc43-3fc7-4415-af11-e32a1280eada admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.214405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:26.215647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:26.294166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33588065-7a59-45c8-803f-1e234089c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.295464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33588065-7a59-45c8-803f-1e234089c1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.296257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33588065-7a59-45c8-803f-1e234089c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.297051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33588065-7a59-45c8-803f-1e234089c1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.297968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33588065-7a59-45c8-803f-1e234089c1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.300824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33588065-7a59-45c8-803f-1e234089c1e7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.311007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1031/2074] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:26.311007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.329264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205085-22ca-4625-abea-a62f6e1217f9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.337526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.338499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.338830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.339579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.341998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:26.342736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.344063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.354674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1044/2075] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/projects => generated 410 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:26.356260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.356552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.356826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.371303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1032/2076] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:26.371303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.387878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811beb7-ad59-4b4b-b0ef-bd382a0d8a5f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.391038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:26.397837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:26.459936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:26.474591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:26.480683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.481782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.482079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.482484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.483370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.485775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.496210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1045/2077] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:26.498599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.504297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:26.540780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1033/2078] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/projects => generated 390 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:26.541675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.634153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66063-c8c0-4627-9a7e-b9d0882fdf02 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.639322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.640083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.640540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.640886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.641692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.644061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.658538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c7ec-dfe4-4a9e-a05d-4a0a63fca122 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.670825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1034/2079] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/users => generated 312 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:26.671746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.682854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1229d-3938-464d-9e74-7fd5613e1116 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.688561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.689508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.689816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.690211 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.690998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.693051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.720149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.721288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.721686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.721996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.725547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1035/2080] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/projects => generated 378 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:26.726840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.733631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.735699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.746660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1046/2081] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:26.747551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.758301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c462f8-371d-45f7-9b0f-32f170aa4d55 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.793516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf77133-5357-4dc0-8a77-0d56cc51e68b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.799121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.799910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.800180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.800459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.834313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.836025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.836346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.836775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.837730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.841549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.871465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1047/2082] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:26.872486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.880769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:26.885578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de8e3-123a-44d3-8304-030f8ca3855e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.891608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.892324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.892627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.892900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.893765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.895438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.902261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.903997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.911309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1048/2083] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:26.912489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.927022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1036/2084] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:26.928585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.931108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ff946-8098-47c9-9f1d-40d951c61ecb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.938433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.939461 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.940082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.940515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.941670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.943174 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bc2d3-bc99-42fc-a430-1fb8d125f291 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:26.944267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.950090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:26.950453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:26.951254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:26.951681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:26.952623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:26.954732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:26.981167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1049/2085] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:26 2022] POST /identity/v3/users => generated 290 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:26.981167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:26.985545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1037/2086] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:26.987462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.006988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61970-95d3-4f25-91e7-b27fd181870a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.015278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.016429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.016902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.017566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.019188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.022124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.027031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903c79-e4e8-4380-b359-be8cb3df32c5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.033880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.034954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.035243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.035520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] PATH_INFO: `/v3/projects/c0567497062d4eae914d568d1bfc6300/users/76292862f3a345119ff891da3663e3d5/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.049292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1038/2087] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:26 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:27.050852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.064441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c49c-5b8a-45de-afb4-519bf62374c3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.066083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:27.074574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.075272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.075564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.075851 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.076152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0567497062d4eae914d568d1bfc6300, user_id=76292862f3a345119ff891da3663e3d5, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.076593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.078268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.084118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.091913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1039/2088] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:27 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:27.092464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.107654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9fe13-c68e-433b-b35b-ca8ed6d14905 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.127594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1050/2089] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:26 2022] PUT /identity/v3/projects/c0567497062d4eae914d568d1bfc6300/users/76292862f3a345119ff891da3663e3d5/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:27.135782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.203840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.205066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.205567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.206009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.207006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.209238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.239034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1040/2090] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:27 2022] GET /identity/v3/roles => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:27.239034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.252384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31528610-9f77-4e7b-9c3a-98772f507218 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.253198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fe0ec-1d12-40ee-914f-6c0e54f644a2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.263760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.264092 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.264913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.265078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.265257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.265510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] PATH_INFO: `/v3/projects/4861c1db50c246c5bf45ea4a99e38c93/users/a82dc94e76464cb6b58591161467484d/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.265609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.266146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.267728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.270956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.281975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4861c1db50c246c5bf45ea4a99e38c93, user_id=a82dc94e76464cb6b58591161467484d, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.284986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.300171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1041/2091] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:27 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:27.302259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.306547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1051/2092] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:27 2022] PUT /identity/v3/projects/4861c1db50c246c5bf45ea4a99e38c93/users/a82dc94e76464cb6b58591161467484d/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:27.318160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.323563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb18d-1256-4135-9552-7de25d2682c7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.483190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aa72e-f68c-4ff6-9036-2af9c2d01a85 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.490038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d6184-14b6-4885-9407-3366861e5608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.491905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d6184-14b6-4885-9407-3366861e5608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.492489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d6184-14b6-4885-9407-3366861e5608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.494339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcd4ab-9746-4ba8-aa87-bb1264a27a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.495861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd4ab-9746-4ba8-aa87-bb1264a27a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.496061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd4ab-9746-4ba8-aa87-bb1264a27a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.496362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd4ab-9746-4ba8-aa87-bb1264a27a9a admin admin] PATH_INFO: `/v3/projects/c0567497062d4eae914d568d1bfc6300/users/76292862f3a345119ff891da3663e3d5/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.499597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcd4ab-9746-4ba8-aa87-bb1264a27a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0567497062d4eae914d568d1bfc6300, user_id=76292862f3a345119ff891da3663e3d5, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.500993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d6184-14b6-4885-9407-3366861e5608 admin admin] PATH_INFO: `/v3/projects/9abb9d142d0d40e99a304c2a2517948a/users/f3428ce791674b949ae8d47637871374/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.503522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcd4ab-9746-4ba8-aa87-bb1264a27a9a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.532599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1052/2093] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:27 2022] PUT /identity/v3/projects/c0567497062d4eae914d568d1bfc6300/users/76292862f3a345119ff891da3663e3d5/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:27.532599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639c7c-aea4-439e-8227-2e6f36a20cc8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.532599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639c7c-aea4-439e-8227-2e6f36a20cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.532599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639c7c-aea4-439e-8227-2e6f36a20cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.535305 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d6184-14b6-4885-9407-3366861e5608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abb9d142d0d40e99a304c2a2517948a, user_id=f3428ce791674b949ae8d47637871374, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.538540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d6184-14b6-4885-9407-3366861e5608 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.568616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1042/2094] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:27 2022] PUT /identity/v3/projects/9abb9d142d0d40e99a304c2a2517948a/users/f3428ce791674b949ae8d47637871374/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:27.570363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.570847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.571314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.592657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7d639c7c-aea4-439e-8227-2e6f36a20cc8 None None] MFA Rules not processed for user `a82dc94e76464cb6b58591161467484d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:27.594897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7d639c7c-aea4-439e-8227-2e6f36a20cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:27.627444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] MFA Rules not processed for user `76292862f3a345119ff891da3663e3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:27.627444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:27.642486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:27.725578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:27.753329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1053/2095] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:27.756274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.756565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.757029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.760916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1043/2096] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:27.762227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.763846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:27.801820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] MFA Rules not processed for user `f3428ce791674b949ae8d47637871374`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:27.803080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:27.895459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1054/2097] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:27.896431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:27.941217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab5fc-107a-49df-b1f8-cd13009390b0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.952676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.955618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.957906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.958771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] PATH_INFO: `/v3/projects/6e5c94976fca408988a21baa61370dfb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.969248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5c94976fca408988a21baa61370dfb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.970635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cb66a-6319-4a2b-bde3-9ce4584841ef None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:27.974092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:27.975943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:27.976866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:27.977285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:27.977662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:27.978469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:27.980513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.039647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1055/2098] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:27 2022] POST /identity/v3/projects => generated 394 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:28.040869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.043094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.067591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5c94976fca408988a21baa61370dfb', 'request_id': 'req-4c79b700-6b18-4e5f-828c-2b22852de4cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.078001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5c94976fca408988a21baa61370dfb', 'request_id': 'req-4c79b700-6b18-4e5f-828c-2b22852de4cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.091786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5c94976fca408988a21baa61370dfb', 'request_id': 'req-4c79b700-6b18-4e5f-828c-2b22852de4cb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.108181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] The token cache is being invalidate because project 6e5c94976fca408988a21baa61370dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:28.108477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.109204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.110970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1044/2099] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:27 2022] DELETE /identity/v3/projects/6e5c94976fca408988a21baa61370dfb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:28.112017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.116460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.155088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee42910-1ddd-450c-9b0e-05a9a571b67b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.170657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:28.185709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:28.219067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79b700-6b18-4e5f-828c-2b22852de4cb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.222290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.223290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.223681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.224060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.226066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.226190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.226850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.227344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.227730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.228602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.231886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.276406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1045/2100] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:28 2022] POST /identity/v3/projects => generated 378 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:28.276406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.277017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.325866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.327340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.341820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1056/2101] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:28.342963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.345168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.362395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ee91-2bc8-486d-bf0f-99f66363ba6e service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.388403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6530-d9dc-4d9a-8674-4c63e62b713d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.402763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.403918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.404207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.405310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.409067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.414774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.465189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1046/2102] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:28 2022] POST /identity/v3/users => generated 304 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:28.468939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.477553 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.486108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.487388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.488085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] PATH_INFO: `/v3/users/43a2fb8a1a8d4aca9edf6682572df409` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.490273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a2fb8a1a8d4aca9edf6682572df409)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.491833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dcbe4-c6ce-497c-a9bc-df276d21ec16 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.493992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.506117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.506342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.506577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.506738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.507445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.515197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.573230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1047/2103] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:28 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:28.573230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.603175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7aa8-b435-46d1-bf8a-53c93f366a69 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.609146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.609912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.610201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.610480 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.611296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.613411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.631717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a2fb8a1a8d4aca9edf6682572df409'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.634497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1048/2104] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:28 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:28.636156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.649800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a2fb8a1a8d4aca9edf6682572df409'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.651109 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a2fb8a1a8d4aca9edf6682572df409'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.658946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52138aca-4db6-4744-aaca-79aea92b5a8a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.669687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a2fb8a1a8d4aca9edf6682572df409'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.670752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a2fb8a1a8d4aca9edf6682572df409'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:28.675409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.677665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.678907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:28.679159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.679938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.683950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:28.687686 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:28.690225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1057/2105] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:28 2022] DELETE /identity/v3/users/43a2fb8a1a8d4aca9edf6682572df409 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:28.691559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.693011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.760787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1049/2106] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:28 2022] GET /identity/v3/roles => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:28.762389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:28.772175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.815693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9c782-49ae-4d90-8bea-25c6dceae0e9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.856005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bdca-7bfa-4c5e-9179-4a1413bda157 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:28.865621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.866304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.866585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.866862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:28.873014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:28.967058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:28.967058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:28.967058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:28.967058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] PATH_INFO: `/v3/projects/191c228f37e1408b93b2be6106fa1a26/users/e0322871a2fd4fee943bd17257e539b6/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.008560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] RBAC: Authorizing `identity:create_grant(project_id=191c228f37e1408b93b2be6106fa1a26, user_id=e0322871a2fd4fee943bd17257e539b6, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.015072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.015510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.017266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.033269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:29.040329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1058/2107] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:28 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:29.041236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:29.043448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:29.053997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1050/2108] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:28 2022] PUT /identity/v3/projects/191c228f37e1408b93b2be6106fa1a26/users/e0322871a2fd4fee943bd17257e539b6/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:29.058719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:29.097074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ede42-0b55-4c46-bbc3-396cee91665b service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:29.265024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08345e-9d56-4675-a9c6-7a118646412c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:29.272305 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:29.274727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:29.275264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.275891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.276008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.276220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.276500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] PATH_INFO: `/v3/projects/0be919fd099d439c865b7cd0524c8456/users/5ae0dede920049d09b94eda03ebad675/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.276793 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.278381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.282471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.296418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be919fd099d439c865b7cd0524c8456, user_id=5ae0dede920049d09b94eda03ebad675, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.299818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.317822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1051/2109] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:29 2022] GET /identity/v3/roles => generated 1427 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:29.319023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:29.335957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1059/2110] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:29 2022] PUT /identity/v3/projects/0be919fd099d439c865b7cd0524c8456/users/5ae0dede920049d09b94eda03ebad675/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:29.338224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:29.340660 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15beab-43f5-4d18-972d-901dc7d3ac0f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:29.413482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:29.468464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d995137-d313-4423-bfc9-70236f3f7d6a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:29.476957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:29.479532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.480480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.480787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.482133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.484769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.491954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a50a-815d-493b-955b-fd22a62090f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:29.492980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a50a-815d-493b-955b-fd22a62090f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.493436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a50a-815d-493b-955b-fd22a62090f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.493875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a50a-815d-493b-955b-fd22a62090f8 admin admin] PATH_INFO: `/v3/projects/191c228f37e1408b93b2be6106fa1a26/users/e0322871a2fd4fee943bd17257e539b6/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.498598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a50a-815d-493b-955b-fd22a62090f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191c228f37e1408b93b2be6106fa1a26, user_id=e0322871a2fd4fee943bd17257e539b6, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.501756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a50a-815d-493b-955b-fd22a62090f8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.512277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1060/2111] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:29 2022] GET /identity/v3/roles => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:29.514944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:29.532646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1052/2112] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:29 2022] PUT /identity/v3/projects/191c228f37e1408b93b2be6106fa1a26/users/e0322871a2fd4fee943bd17257e539b6/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:29.537532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48462ea4-7225-4d52-91e9-b7ae7ff8385f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:29.540729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97fd61-6dc0-4f3a-8662-26da7d19bfcd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.541029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97fd61-6dc0-4f3a-8662-26da7d19bfcd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.541419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97fd61-6dc0-4f3a-8662-26da7d19bfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.600605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4f97fd61-6dc0-4f3a-8662-26da7d19bfcd None None] MFA Rules not processed for user `e0322871a2fd4fee943bd17257e539b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:29.601945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4f97fd61-6dc0-4f3a-8662-26da7d19bfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:29.692803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:29.694278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.694754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.695181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] PATH_INFO: `/v3/projects/0be919fd099d439c865b7cd0524c8456/users/5ae0dede920049d09b94eda03ebad675/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.713495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be919fd099d439c865b7cd0524c8456, user_id=5ae0dede920049d09b94eda03ebad675, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.724211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.757469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1061/2113] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:29 2022] PUT /identity/v3/projects/0be919fd099d439c865b7cd0524c8456/users/5ae0dede920049d09b94eda03ebad675/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:29.758486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:29.762504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1053/2114] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:29.767328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:29.770362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.771963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.773997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.826485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:29.834731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] MFA Rules not processed for user `5ae0dede920049d09b94eda03ebad675`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:29.837826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:29.930881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c8466-2892-4852-9adc-deea3d756d40 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:29.937779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:29.938920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:29.939317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:29.939709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] PATH_INFO: `/v3/projects/bbba3b14abf446419701f0b032a44ed0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:29.941049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbba3b14abf446419701f0b032a44ed0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:29.943203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:29.961307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1054/2115] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:29.962265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.020300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbba3b14abf446419701f0b032a44ed0', 'request_id': 'req-79053622-7729-4ab2-9581-7455137e0995'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:30.033146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbba3b14abf446419701f0b032a44ed0', 'request_id': 'req-79053622-7729-4ab2-9581-7455137e0995'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:30.045082 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbba3b14abf446419701f0b032a44ed0', 'request_id': 'req-79053622-7729-4ab2-9581-7455137e0995'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:30.049990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:30.051687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8401433-80eb-4c2c-8874-e4f28a141947 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.071267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] The token cache is being invalidate because project bbba3b14abf446419701f0b032a44ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:30.071697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:30.072986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:30.077094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1062/2116] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:29 2022] DELETE /identity/v3/projects/bbba3b14abf446419701f0b032a44ed0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:30.082833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.090088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.152346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.153102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.153434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.153731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.158082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.201257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79053622-7729-4ab2-9581-7455137e0995 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.206280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.207068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.207428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.207767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.209804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.297155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.299239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fa001-6f7b-458d-b9f8-a19607d0e9b9 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:30.310861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1055/2117] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:30.312469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec79c4-e15f-4625-9160-78446f1851c0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.312757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec79c4-e15f-4625-9160-78446f1851c0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.313038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec79c4-e15f-4625-9160-78446f1851c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.325630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:30.339924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f4ec79c4-e15f-4625-9160-78446f1851c0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:30.341192 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f4ec79c4-e15f-4625-9160-78446f1851c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.347635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.349076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:30.377803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1063/2118] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:30.398930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.403041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.415039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353747e2-cd88-4ca8-a684-7da0dfbe015d service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.420151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.422645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.423053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.423509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.425827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.463278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1056/2119] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:30.466844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.468057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.468558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.514086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:30.515412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:30.532284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1057/2120] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:30.537180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.548391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.550051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:30.562790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1064/2121] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:30.565440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce561c4d-2393-4222-b75f-9b0882d80002 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.573145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.573843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.574281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.574399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.575139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:30.575572 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.577096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:30.611387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1058/2122] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:30.613415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.639771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd015e4-d9a6-4afd-b62a-304e60d4a65f service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.648894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.650835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.653905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.654410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.655342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.657662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:30.710756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1065/2123] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:30 2022] POST /identity/v3/projects => generated 376 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:30.712518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.729019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b28e1-a4ba-4d07-ac80-177d8546d4bc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.852132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.854531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.855064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.855361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.856160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.860216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:30.912286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1059/2124] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:30 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:30.918450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:30.955065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7e67-ba49-43cc-9e54-1f158dbede54 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:30.971355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:30.972434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:30.972806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:30.973128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:30.974957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:30.979829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:31.013318 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1066/2125] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:30 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:31.016383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:31.048452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84558ee9-67de-4b74-b864-b24898e0c868 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:31.082470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad0165-b09f-494e-850f-58f8819a704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:31.087921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0165-b09f-494e-850f-58f8819a704f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:31.090091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0165-b09f-494e-850f-58f8819a704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:31.090478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0165-b09f-494e-850f-58f8819a704f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:31.091381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad0165-b09f-494e-850f-58f8819a704f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:31.096167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad0165-b09f-494e-850f-58f8819a704f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:31.149080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1060/2126] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:31 2022] GET /identity/v3/roles => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:31.153893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:31.179416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0408f8-34e0-4517-93f2-73f9fdac22b1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:31.188626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:31.191484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:31.191961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:31.192738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] PATH_INFO: `/v3/projects/890c87fdb49049b180af74572910831e/users/f7e053da38934b4bac905067ab3ebb5e/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:31.212939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:31.219884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] RBAC: Authorizing `identity:create_grant(project_id=890c87fdb49049b180af74572910831e, user_id=f7e053da38934b4bac905067ab3ebb5e, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:31.223782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:31.253771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1067/2127] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:31 2022] PUT /identity/v3/projects/890c87fdb49049b180af74572910831e/users/f7e053da38934b4bac905067ab3ebb5e/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:31.266346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94b05-ab47-452f-8d0f-918f839d5263 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:31.267698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94b05-ab47-452f-8d0f-918f839d5263 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:31.268233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94b05-ab47-452f-8d0f-918f839d5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:31.340668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-84a94b05-ab47-452f-8d0f-918f839d5263 None None] MFA Rules not processed for user `f7e053da38934b4bac905067ab3ebb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:31.342298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-84a94b05-ab47-452f-8d0f-918f839d5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:31.489509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:31.506797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1061/2128] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:31.521777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:31.604658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c33e6-5fc2-45c5-94a9-f35f8a38659d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:31.609177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5d98b-6cb8-4941-924a-826e3aa2c168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:31.609434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d98b-6cb8-4941-924a-826e3aa2c168 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:31.609769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d98b-6cb8-4941-924a-826e3aa2c168 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:31.610002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d98b-6cb8-4941-924a-826e3aa2c168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:31.625225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5d98b-6cb8-4941-924a-826e3aa2c168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:31.625782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5d98b-6cb8-4941-924a-826e3aa2c168 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:31.639563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1068/2129] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:33.430538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:33.431407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:33.431840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:33.475552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] MFA Rules not processed for user `5a1a910de31044ab9c8dcfb2bb4651c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:33.476974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:33.584582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1062/2130] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:33.597396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:33.597924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:33.597924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:33.651738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] MFA Rules not processed for user `5a1a910de31044ab9c8dcfb2bb4651c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:33.652977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:33.661075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1069/2131] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:33.683671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:33.685309 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:33.839080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce231f-79ed-45ed-b604-12016dd10ed3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:33.845611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05aafa-4787-4492-83f3-f0da725ef98d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:33.846460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:33.846579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05aafa-4787-4492-83f3-f0da725ef98d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:33.847132 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05aafa-4787-4492-83f3-f0da725ef98d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:33.848191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05aafa-4787-4492-83f3-f0da725ef98d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:33.856890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73f094-b9f3-41dd-a9a5-0303005096e6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:33.861107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:33.861890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:33.862247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:33.862537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:33.864550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:33.866716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05aafa-4787-4492-83f3-f0da725ef98d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:33.868389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05aafa-4787-4492-83f3-f0da725ef98d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:33.887635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1063/2132] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:33.976900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:33.978540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:33.992481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1070/2133] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:34.935076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9e82-b61e-48a5-94b3-60bf6ff7d508 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:34.935527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9e82-b61e-48a5-94b3-60bf6ff7d508 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:34.935926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9e82-b61e-48a5-94b3-60bf6ff7d508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:34.960953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cdcf9e82-b61e-48a5-94b3-60bf6ff7d508 None None] MFA Rules not processed for user `5a1a910de31044ab9c8dcfb2bb4651c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:34.962762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cdcf9e82-b61e-48a5-94b3-60bf6ff7d508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:34.972758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1064/2134] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:35.074243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:35.078265 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:35.190348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be1008-b73f-4585-92fd-f752d6638dc9 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:35.200475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:35.201740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:35.202185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:35.202472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] PATH_INFO: `/v3/users/a82dc94e76464cb6b58591161467484d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:35.203860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82dc94e76464cb6b58591161467484d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:35.206978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:35.247257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:35.288663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82dc94e76464cb6b58591161467484d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.304363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82dc94e76464cb6b58591161467484d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.305350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82dc94e76464cb6b58591161467484d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.316698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82dc94e76464cb6b58591161467484d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.317984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82dc94e76464cb6b58591161467484d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.337063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1071/2135] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:35 2022] DELETE /identity/v3/users/a82dc94e76464cb6b58591161467484d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:35.341972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:35.342313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:35.342634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:35.368935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:35.370681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:35.452213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:35.456655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:35.482307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1065/2136] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:35.495788 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:35.497781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:35.504415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:35.548972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670495-ef5c-4ac3-9821-21fb48f1d5b9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:35.554791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:35.555862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:35.556150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:35.556429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] PATH_INFO: `/v3/users/f7e053da38934b4bac905067ab3ebb5e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:35.557799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e053da38934b4bac905067ab3ebb5e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:35.562990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:35.605683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07354d-a4d4-4666-a2ef-d279f28bd65a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:35.615398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42faf-aa95-427f-b485-eb618cdddce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:35.616900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42faf-aa95-427f-b485-eb618cdddce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:35.617230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42faf-aa95-427f-b485-eb618cdddce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:35.625511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42faf-aa95-427f-b485-eb618cdddce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:35.640434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42faf-aa95-427f-b485-eb618cdddce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:35.642934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42faf-aa95-427f-b485-eb618cdddce7 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:35.648405 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e053da38934b4bac905067ab3ebb5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.656331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1066/2137] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:35.700098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e053da38934b4bac905067ab3ebb5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.700998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e053da38934b4bac905067ab3ebb5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.730660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e053da38934b4bac905067ab3ebb5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.731841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e053da38934b4bac905067ab3ebb5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:35.776429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:35.776913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:35.777157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:35.779950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1072/2138] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:35 2022] DELETE /identity/v3/users/f7e053da38934b4bac905067ab3ebb5e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:35.821272 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:35.822808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.095938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1067/2139] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:36.105034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:36.106757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.144243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:36.146672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.165668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:36.179397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf8ca-82da-4038-bdbc-4bb1b9897447 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:36.208052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:36.208984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:36.209343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:36.211511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] PATH_INFO: `/v3/users/8bb03080bb91456d98510713c1a1af1f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:36.215280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb03080bb91456d98510713c1a1af1f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:36.221264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:36.291730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880d98d-fcc6-44ef-bd7f-63cc7676f46d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:36.299437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:36.300189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:36.300688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:36.300969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:36.313046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:36.323606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:36.326288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb03080bb91456d98510713c1a1af1f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.328284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb03080bb91456d98510713c1a1af1f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.329837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb03080bb91456d98510713c1a1af1f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.340177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1073/2140] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:36.342726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:36.346037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.364811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb03080bb91456d98510713c1a1af1f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.367048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5eb22-e676-4344-97bc-d4bcfb1a2fa6 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:36.373109 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:36.374459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:36.375015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:36.376281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] PATH_INFO: `/v3/projects/4861c1db50c246c5bf45ea4a99e38c93` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:36.384605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5d1bccb1-60c3-44cd-a981-22c0eecbfbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb03080bb91456d98510713c1a1af1f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.391116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4861c1db50c246c5bf45ea4a99e38c93)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:36.398279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:36.477313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1068/2141] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:36 2022] DELETE /identity/v3/users/8bb03080bb91456d98510713c1a1af1f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:36.496173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:36.496896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:36.498036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:36.613636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:36.619618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.733054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:36.748507 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4861c1db50c246c5bf45ea4a99e38c93', 'request_id': 'req-a3fd7434-a069-47de-9046-236fb08a83cb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.774509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4861c1db50c246c5bf45ea4a99e38c93', 'request_id': 'req-a3fd7434-a069-47de-9046-236fb08a83cb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.792545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4861c1db50c246c5bf45ea4a99e38c93', 'request_id': 'req-a3fd7434-a069-47de-9046-236fb08a83cb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.848050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] The token cache is being invalidate because project 4861c1db50c246c5bf45ea4a99e38c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:36.848441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.855395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:36.859924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1074/2142] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:36 2022] DELETE /identity/v3/projects/4861c1db50c246c5bf45ea4a99e38c93 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:36.866067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:36.874292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.941671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1069/2143] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:36.942940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:36.955389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:36.985095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4414-b25f-45d2-b282-0e4b775acb64 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:37.056887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7434-a069-47de-9046-236fb08a83cb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:37.069310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:37.070230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:37.070506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:37.070778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] PATH_INFO: `/v3/users/e0322871a2fd4fee943bd17257e539b6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:37.072048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0322871a2fd4fee943bd17257e539b6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:37.075457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:37.145359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:37.146371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:37.146743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:37.147090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] PATH_INFO: `/v3/projects/890c87fdb49049b180af74572910831e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:37.149632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890c87fdb49049b180af74572910831e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:37.180504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:37.195825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:37.212565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0322871a2fd4fee943bd17257e539b6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.259436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0322871a2fd4fee943bd17257e539b6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.260623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0322871a2fd4fee943bd17257e539b6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.275468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890c87fdb49049b180af74572910831e', 'request_id': 'req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.276166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0322871a2fd4fee943bd17257e539b6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.277183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0322871a2fd4fee943bd17257e539b6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.295811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890c87fdb49049b180af74572910831e', 'request_id': 'req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.306561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1075/2144] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:36 2022] DELETE /identity/v3/users/e0322871a2fd4fee943bd17257e539b6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:37.306561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:37.307329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:37.351213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890c87fdb49049b180af74572910831e', 'request_id': 'req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.412615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] The token cache is being invalidate because project 890c87fdb49049b180af74572910831e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:37.412942 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.415883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:37.424752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1070/2145] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:36 2022] DELETE /identity/v3/projects/890c87fdb49049b180af74572910831e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:37.447222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01110-ca4d-4eed-bad5-d4baf25eb097 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:37.483557 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:37.484306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:37.484599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:37.484863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:37.499962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:37.755050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:37.756961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:37.777842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1076/2146] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:38.299918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:38.301707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:38.450925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:38.452432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:38.484471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5b96-3c00-4769-94c1-e3de1b4cd609 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:38.502437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:38.503353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:38.503639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:38.503917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] PATH_INFO: `/v3/projects/bc0d319da8a047f0b3070814810bace9` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:38.511969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0d319da8a047f0b3070814810bace9)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:38.516504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:38.549515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:38.592448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e109a8e-8a66-4fa0-b4fd-f21a9cf6e663 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:38.625303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:38.625303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:38.625303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:38.625303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] PATH_INFO: `/v3/projects/191c228f37e1408b93b2be6106fa1a26` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:38.625837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] RBAC: Authorizing `identity:delete_project(project_id=191c228f37e1408b93b2be6106fa1a26)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:38.636502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:38.672295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0d319da8a047f0b3070814810bace9', 'request_id': 'req-70e1d7ff-5dea-4406-853f-d6f71a822c72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.687934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0d319da8a047f0b3070814810bace9', 'request_id': 'req-70e1d7ff-5dea-4406-853f-d6f71a822c72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.721819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0d319da8a047f0b3070814810bace9', 'request_id': 'req-70e1d7ff-5dea-4406-853f-d6f71a822c72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.727591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:38.771150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] The token cache is being invalidate because project bc0d319da8a047f0b3070814810bace9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:38.778817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.780684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.783299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1077/2147] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:38 2022] DELETE /identity/v3/projects/bc0d319da8a047f0b3070814810bace9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:38.786747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:38.789501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:38.796281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191c228f37e1408b93b2be6106fa1a26', 'request_id': 'req-7ec995b4-a830-4a01-bdcd-8f360170770a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.812481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191c228f37e1408b93b2be6106fa1a26', 'request_id': 'req-7ec995b4-a830-4a01-bdcd-8f360170770a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.823918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191c228f37e1408b93b2be6106fa1a26', 'request_id': 'req-7ec995b4-a830-4a01-bdcd-8f360170770a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.862469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] The token cache is being invalidate because project 191c228f37e1408b93b2be6106fa1a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:38.863235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.863885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7ec995b4-a830-4a01-bdcd-8f360170770a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:38.866109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1071/2148] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:38 2022] DELETE /identity/v3/projects/191c228f37e1408b93b2be6106fa1a26 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:38.875242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf3c9-1b0f-438e-9668-ba19a7405456 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:38.875242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf3c9-1b0f-438e-9668-ba19a7405456 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:38.875242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf3c9-1b0f-438e-9668-ba19a7405456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:38.932084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-42dbf3c9-1b0f-438e-9668-ba19a7405456 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:38.935135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-42dbf3c9-1b0f-438e-9668-ba19a7405456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:39.060615 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1d7ff-5dea-4406-853f-d6f71a822c72 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.126852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1072/2149] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:39.135281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049268a-9470-4865-827b-c4a826842d65 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.135616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049268a-9470-4865-827b-c4a826842d65 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.137082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049268a-9470-4865-827b-c4a826842d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.179786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.180837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.181172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.181601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] PATH_INFO: `/v3/users/76292862f3a345119ff891da3663e3d5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.185547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76292862f3a345119ff891da3663e3d5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.197357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:39.204337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9049268a-9470-4865-827b-c4a826842d65 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:39.209627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9049268a-9470-4865-827b-c4a826842d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:39.240299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1073/2150] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:39.245110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049268a-9470-4865-827b-c4a826842d65 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.273384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049268a-9470-4865-827b-c4a826842d65 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.287672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.288531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.288842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.289937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.290999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:39.293499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.299314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:39.326003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76292862f3a345119ff891da3663e3d5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:39.355897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1074/2151] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:39.363834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.365331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76292862f3a345119ff891da3663e3d5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:39.366439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76292862f3a345119ff891da3663e3d5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:39.386093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76292862f3a345119ff891da3663e3d5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:39.389502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76292862f3a345119ff891da3663e3d5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:39.402258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd91f8-3be5-4f9d-a0ce-9f42cc4f4927 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.414728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.415757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.417213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.418574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.420329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.424937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:39.426574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1078/2152] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:38 2022] DELETE /identity/v3/users/76292862f3a345119ff891da3663e3d5 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:39.481232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1075/2153] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:39 2022] POST /identity/v3/projects => generated 378 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:39.482844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.487540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:39.564291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:39.650716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d12a2-a8d0-45db-bc3f-9960b624b9f6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.739283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.740131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.740417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.740902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.741818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.744286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:39.790985 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1079/2154] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:39 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:39.795457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.816050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31382f4-4a83-4fcb-b3f9-8dddd48d5a9a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.826682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.828335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.828707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.829060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.830415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.833500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:39.855198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1076/2155] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:39 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:39.856834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.872732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eb62c-e8e4-4eee-b553-64be2b8f9ca5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.891496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.891496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.891496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.891496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.892234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.893364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:39.906331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1080/2156] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:39 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:39.911841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.929425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:39.931630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:39.933536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17580cd9-7bce-4f7f-bca7-34bc06922f51 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.954658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b64f7-7141-4f1a-8ddf-fc9ee92c0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.958273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b64f7-7141-4f1a-8ddf-fc9ee92c0deb admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.958374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b64f7-7141-4f1a-8ddf-fc9ee92c0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.958661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b64f7-7141-4f1a-8ddf-fc9ee92c0deb admin admin] PATH_INFO: `/v3/projects/640c49efccee4c0c8ada6d370cd3c23d/users/bd2ab5f8b7a142da9e3df0cb906e188d/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.976063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f6ded-f51c-4c2d-b9f6-6f0b9c2a2163 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:39.991167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:39.992918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:39.993273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:39.993522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] PATH_INFO: `/v3/projects/c0567497062d4eae914d568d1bfc6300` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:39.994954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0567497062d4eae914d568d1bfc6300)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:39.996930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:40.016801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b64f7-7141-4f1a-8ddf-fc9ee92c0deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=640c49efccee4c0c8ada6d370cd3c23d, user_id=bd2ab5f8b7a142da9e3df0cb906e188d, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:40.019727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b64f7-7141-4f1a-8ddf-fc9ee92c0deb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:40.046522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1077/2157] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:39 2022] PUT /identity/v3/projects/640c49efccee4c0c8ada6d370cd3c23d/users/bd2ab5f8b7a142da9e3df0cb906e188d/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:40.058089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.058382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.058666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.069361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:40.111239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] MFA Rules not processed for user `bd2ab5f8b7a142da9e3df0cb906e188d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:40.114118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:40.131462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0567497062d4eae914d568d1bfc6300', 'request_id': 'req-ccd6e7c3-981d-4987-8381-7175118b9750'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:40.146274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0567497062d4eae914d568d1bfc6300', 'request_id': 'req-ccd6e7c3-981d-4987-8381-7175118b9750'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:40.159892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0567497062d4eae914d568d1bfc6300', 'request_id': 'req-ccd6e7c3-981d-4987-8381-7175118b9750'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:40.192031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] The token cache is being invalidate because project c0567497062d4eae914d568d1bfc6300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:40.192815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:40.196093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ccd6e7c3-981d-4987-8381-7175118b9750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:40.207274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1081/2158] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:39 2022] DELETE /identity/v3/projects/c0567497062d4eae914d568d1bfc6300 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:40.209023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d2df-397f-48a0-9a48-b54c64ead2d6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.209308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d2df-397f-48a0-9a48-b54c64ead2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.209586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d2df-397f-48a0-9a48-b54c64ead2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.282854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7e81d2df-397f-48a0-9a48-b54c64ead2d6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:40.306202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7e81d2df-397f-48a0-9a48-b54c64ead2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:40.314792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1078/2159] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:40.319199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:40.321363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:40.415601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:40.541719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1082/2160] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:40.545838 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.546169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.546456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.603678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:40.605004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:40.613392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b7758-7d01-43a0-9b10-ff9994497bce None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:40.634875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:40.636829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.638129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.638878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.640292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:40.644518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:40.653398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1083/2161] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:40.654427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:40.676513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445ae2-b020-4010-8d08-412d835b625a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:40.689230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:40.690760 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.693067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.694545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.694545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:40.694545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:40.698012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:40.703229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1079/2162] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/projects => generated 380 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:40.708172 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:40.735668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1084/2163] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:40.740179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:40.767349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee88737-8864-4fd2-9ab4-2535fe46931d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:40.901439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:40.902516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.903829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.906487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.907572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:40.911044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:40.941298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d33d-9f6a-4a81-bab9-cc0f593cc165 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:40.976693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1085/2164] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/projects => generated 386 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:40.982683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:40.982911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:40.986385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:40.986385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:40.986385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:40.989761 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:40.999270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.077275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1080/2165] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/users => generated 291 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:41.080446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.098327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5566e-0105-4729-94f5-d63ab7f55e6d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.114221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:41.116908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b0a49-9fb5-4c23-9d63-3ad588ab5c82 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.124118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.126061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.126535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.128219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.129662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.132950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.173723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1086/2166] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:40 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:41.178473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.210616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a95514-354b-4e69-862f-94f4d79066e9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.224852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.226916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.227904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.228257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.228369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.228724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.229844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.232560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.232921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.233037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.234000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.237035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.248252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1081/2167] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:41 2022] GET /identity/v3/roles => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:20:41.253397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.263333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1087/2168] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:41 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:41.265860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.284119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a71cc5-6f40-401f-ae6f-60c746605ba3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.295057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.295057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.295057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.295432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.296188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.296850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548525a-e71c-4997-a808-06fd44cb07b3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.298381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.307058 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.308451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.309078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.309752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.312608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.317268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1088/2169] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:41 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:41.317428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.319459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.328492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:41.334907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49485-b458-4fb9-881a-db39584310fc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.339462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1082/2170] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:41 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:41.340448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.344882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95fd91-b2e8-462a-97c5-8552caccd783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.346584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95fd91-b2e8-462a-97c5-8552caccd783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.346893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95fd91-b2e8-462a-97c5-8552caccd783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.347410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95fd91-b2e8-462a-97c5-8552caccd783 admin admin] PATH_INFO: `/v3/projects/54f1768d758a4711916a601e8b1c4216/users/23baef686f0b4cd98048aa1ed597fc88/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.352774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e2cf-20b7-469b-8417-384f9c413266 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.364672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f88a6-a778-4c0d-a7fd-d2b49b2d34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.366087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f88a6-a778-4c0d-a7fd-d2b49b2d34c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.366378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f88a6-a778-4c0d-a7fd-d2b49b2d34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.366655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f88a6-a778-4c0d-a7fd-d2b49b2d34c3 admin admin] PATH_INFO: `/v3/projects/35cd161d976d4eeebef05bd02efb91cb/users/3bfc7b9ffb244a20a9230ec2f63e07d2/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.374404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95fd91-b2e8-462a-97c5-8552caccd783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f1768d758a4711916a601e8b1c4216, user_id=23baef686f0b4cd98048aa1ed597fc88, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.377410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95fd91-b2e8-462a-97c5-8552caccd783 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.397646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1089/2171] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:41 2022] PUT /identity/v3/projects/54f1768d758a4711916a601e8b1c4216/users/23baef686f0b4cd98048aa1ed597fc88/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:41.398198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f88a6-a778-4c0d-a7fd-d2b49b2d34c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cd161d976d4eeebef05bd02efb91cb, user_id=3bfc7b9ffb244a20a9230ec2f63e07d2, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.398198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f88a6-a778-4c0d-a7fd-d2b49b2d34c3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.408714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.409380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.409923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.423173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1083/2172] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:41 2022] PUT /identity/v3/projects/35cd161d976d4eeebef05bd02efb91cb/users/3bfc7b9ffb244a20a9230ec2f63e07d2/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:41.433509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.434382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.435016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.449560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] MFA Rules not processed for user `23baef686f0b4cd98048aa1ed597fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:41.450630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:41.483992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] MFA Rules not processed for user `3bfc7b9ffb244a20a9230ec2f63e07d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:41.485527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:41.560033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1090/2173] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:41.565282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.578454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1084/2174] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:41.584329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.669313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ea1b-76bf-4d71-b1df-84219c22d7b6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.675029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.675719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.676189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.676469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.677248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.677562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:41.679315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.683404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e990dd2-0d90-42c5-b9d0-ca72a9ad4b8d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.694266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.694895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.695355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.695779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.696523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.698722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.727701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1091/2175] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:41 2022] POST /identity/v3/projects => generated 388 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:41.730486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.742713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1085/2176] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:41 2022] POST /identity/v3/projects => generated 380 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:41.748882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.826168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:41.850828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b0eb-824f-4889-b937-f313bfbdb416 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.880939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b2b78-2d84-4f2e-9574-53ddeb2d046b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:41.900472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.901204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.901492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.901772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.902643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.906476 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.940944 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:41.941919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:41.942278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:41.942724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:41.943603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:41.945933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:41.964159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1086/2177] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:41 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:41.970944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:41.992424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886c45d-e4d2-4f38-9169-a04ac97ea696 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.003645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.004964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1092/2178] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:41 2022] POST /identity/v3/users => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:42.005814 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.006316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.006790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.008836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.009008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.012202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.035621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4ab9b-deab-424a-bb6a-19bfed00db6c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.040893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.041551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.041837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.041972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1087/2179] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:41 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:42.042125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.042854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.044699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.046914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.064613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1093/2180] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:42 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:42.068825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.082956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10638b7a-1190-4a10-92ca-5c10c1a95889 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.092250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.093310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.093595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.093877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] PATH_INFO: `/v3/projects/84e2767b2e0d43269020a004c4d86870/users/eb3fec69043445538da95717ce4a471d/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.107603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899b5bb-4ee5-4e5e-bd13-dc29e785802f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.127068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.129593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.130493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.131380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] PATH_INFO: `/v3/projects/d01dd27ab7bf4c7893545059d3fe4052/users/8cb0c0f1a3154ed5acf07f9120493d0b/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.140512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e2767b2e0d43269020a004c4d86870, user_id=eb3fec69043445538da95717ce4a471d, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.143576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.165905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1094/2181] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:42 2022] PUT /identity/v3/projects/84e2767b2e0d43269020a004c4d86870/users/eb3fec69043445538da95717ce4a471d/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:42.166901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01dd27ab7bf4c7893545059d3fe4052, user_id=8cb0c0f1a3154ed5acf07f9120493d0b, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.170029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.173024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.204510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1088/2182] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:42 2022] PUT /identity/v3/projects/d01dd27ab7bf4c7893545059d3fe4052/users/8cb0c0f1a3154ed5acf07f9120493d0b/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:42.205387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.258782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2572a-4c82-41ad-8b90-061bb2a687b9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.298748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7214272-3ae7-4abb-8dde-930aa821f929 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.305263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.306082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.306475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.306877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.307747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.311650 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.337397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1089/2183] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:42 2022] GET /identity/v3/roles => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:20:42.337397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.342349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273217f8-7626-4c86-a11b-f595b471279f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.349175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1f38d-e762-430d-b304-6dfcd1331537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.349900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f38d-e762-430d-b304-6dfcd1331537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.350183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f38d-e762-430d-b304-6dfcd1331537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.350457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1f38d-e762-430d-b304-6dfcd1331537 admin admin] PATH_INFO: `/v3/projects/d01dd27ab7bf4c7893545059d3fe4052/users/8cb0c0f1a3154ed5acf07f9120493d0b/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.352645 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1f38d-e762-430d-b304-6dfcd1331537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01dd27ab7bf4c7893545059d3fe4052, user_id=8cb0c0f1a3154ed5acf07f9120493d0b, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.355564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1f38d-e762-430d-b304-6dfcd1331537 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.358093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.359128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.359694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.360220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.362196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.365080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.372418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1090/2184] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:42 2022] PUT /identity/v3/projects/d01dd27ab7bf4c7893545059d3fe4052/users/8cb0c0f1a3154ed5acf07f9120493d0b/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:42.378821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:42.383477 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1095/2185] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:42 2022] GET /identity/v3/roles => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:42.386640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.387398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.387867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.390901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.414592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5caadc-537e-4cbe-b0e4-b862d7edde43 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.430619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] MFA Rules not processed for user `8cb0c0f1a3154ed5acf07f9120493d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:42.431884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:42.446482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:42.489847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57ee4b-1fc1-4c6f-bbcd-0a693a41563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.490684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ee4b-1fc1-4c6f-bbcd-0a693a41563b admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.491877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ee4b-1fc1-4c6f-bbcd-0a693a41563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.492211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ee4b-1fc1-4c6f-bbcd-0a693a41563b admin admin] PATH_INFO: `/v3/projects/84e2767b2e0d43269020a004c4d86870/users/eb3fec69043445538da95717ce4a471d/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.495143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57ee4b-1fc1-4c6f-bbcd-0a693a41563b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e2767b2e0d43269020a004c4d86870, user_id=eb3fec69043445538da95717ce4a471d, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.498546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57ee4b-1fc1-4c6f-bbcd-0a693a41563b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.510691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1096/2186] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:42 2022] PUT /identity/v3/projects/84e2767b2e0d43269020a004c4d86870/users/eb3fec69043445538da95717ce4a471d/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:42.521394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.521751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.521968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.551264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1091/2187] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:42.560327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] MFA Rules not processed for user `eb3fec69043445538da95717ce4a471d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:42.561634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:42.578438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.581952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:42.665481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1097/2188] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:42.669460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a315564-2507-43d6-953d-3ca756d6d4eb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.674347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.675968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:42.747557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.748541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.748786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.749143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.766414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43317d4a-c047-4885-9ed4-d8c4e024c508 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.771212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.772031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.772381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.773211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.784782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.786398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.801795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1098/2189] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:42.854278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:42.855928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:42.868303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1092/2190] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:42.925940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:42.936874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1662aa9-450e-4bb2-8a4a-925c9db2bfe5 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:42.941818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ffac-35c0-489e-b9f4-ea59e378b497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:42.942587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ffac-35c0-489e-b9f4-ea59e378b497 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:42.942926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ffac-35c0-489e-b9f4-ea59e378b497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:42.943268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ffac-35c0-489e-b9f4-ea59e378b497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:42.969561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:43.034743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ffac-35c0-489e-b9f4-ea59e378b497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:43.034918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ffac-35c0-489e-b9f4-ea59e378b497 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:43.047448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1099/2191] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:43.993551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:44.007097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:44.063307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152f9d-1348-488e-8f83-98694dd6c853 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:44.068456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:44.069450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:44.069734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:44.070009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] PATH_INFO: `/v3/users/23baef686f0b4cd98048aa1ed597fc88` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:44.071326 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23baef686f0b4cd98048aa1ed597fc88)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:44.073394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:44.130234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23baef686f0b4cd98048aa1ed597fc88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.131020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23baef686f0b4cd98048aa1ed597fc88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.131733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23baef686f0b4cd98048aa1ed597fc88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.153617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23baef686f0b4cd98048aa1ed597fc88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.164536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23baef686f0b4cd98048aa1ed597fc88'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.179714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1093/2192] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:43 2022] DELETE /identity/v3/users/23baef686f0b4cd98048aa1ed597fc88 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:44.184447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:44.184955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:44.185169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:44.205841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:44.207105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:44.274862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1100/2193] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:44.285859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:44.287816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:44.348641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b45b16-6f28-488a-a80e-8c6482947784 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:44.352377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:44.353049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:44.353371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:44.353623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:44.363523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:44.365015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:44.375881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1094/2194] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:44.658622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:44.660093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:44.673788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d800c4-62ad-420a-9e4d-5306e3f0926b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:44.680722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:44.681835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:44.682350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:44.682843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] PATH_INFO: `/v3/projects/54f1768d758a4711916a601e8b1c4216` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:44.684978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f1768d758a4711916a601e8b1c4216)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:44.688940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:44.749729 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f1768d758a4711916a601e8b1c4216', 'request_id': 'req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.759294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f1768d758a4711916a601e8b1c4216', 'request_id': 'req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.767303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f1768d758a4711916a601e8b1c4216', 'request_id': 'req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.782392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] The token cache is being invalidate because project 54f1768d758a4711916a601e8b1c4216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:44.782688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.783453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:44.785180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1101/2195] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:44 2022] DELETE /identity/v3/projects/54f1768d758a4711916a601e8b1c4216 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:44.789570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:44.800034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a2da-28fb-4dd7-9e87-6faabdf8bebd service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:44.855705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:44.925695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:44.926891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:44.928852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:44.929581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] PATH_INFO: `/v3/users/eb3fec69043445538da95717ce4a471d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:44.931296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3fec69043445538da95717ce4a471d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:44.933715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:45.018981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3fec69043445538da95717ce4a471d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.019850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3fec69043445538da95717ce4a471d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.020563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3fec69043445538da95717ce4a471d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.036928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3fec69043445538da95717ce4a471d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.053701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ccd20eaa-b31c-4e19-9538-43126bb6fcca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3fec69043445538da95717ce4a471d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.073655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1095/2196] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:44 2022] DELETE /identity/v3/users/eb3fec69043445538da95717ce4a471d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:45.575347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:45.576984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:45.592562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dfec4-2f82-4d0d-a81c-2ab9a2c3f6bd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:45.641981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:45.667947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:45.669040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:45.669359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:45.669713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] PATH_INFO: `/v3/projects/84e2767b2e0d43269020a004c4d86870` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:45.670978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e2767b2e0d43269020a004c4d86870)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:45.673346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:45.724761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e2767b2e0d43269020a004c4d86870', 'request_id': 'req-58f056b1-5142-4038-93d5-8bddf882990d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.733923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e2767b2e0d43269020a004c4d86870', 'request_id': 'req-58f056b1-5142-4038-93d5-8bddf882990d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.741599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e2767b2e0d43269020a004c4d86870', 'request_id': 'req-58f056b1-5142-4038-93d5-8bddf882990d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.754441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] The token cache is being invalidate because project 84e2767b2e0d43269020a004c4d86870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:45.754862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.755664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-58f056b1-5142-4038-93d5-8bddf882990d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:45.757437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1102/2197] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:45 2022] DELETE /identity/v3/projects/84e2767b2e0d43269020a004c4d86870 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:45.763704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:45.764049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:45.764337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:45.787007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:45.788243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:45.852987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1096/2198] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:45.862508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:45.862865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:45.863198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:45.883991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:45.885283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:45.894243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1103/2199] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:45.899724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:45.909904 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f17c7d-7881-4f42-b50b-d0c89f5a5183 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:45.915009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:45.915687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:45.916001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:45.916253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:45.917054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:45.917396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:45.919070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:45.931369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1097/2200] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:45.935807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:45.945819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f1129-0415-40ef-bb58-73f1fd4fcf13 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:45.951372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:45.952305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:45.952670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:45.953040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:45.953915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:45.956975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:45.991073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1104/2201] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:45 2022] POST /identity/v3/projects => generated 386 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:45.995539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:46.006583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ecd62-a5f4-448f-945e-875d0e21bbd3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:46.047044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:46.067776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:46.068461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:46.068748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:46.069026 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:46.069839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:46.071795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:46.096951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1098/2202] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:45 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:46.101451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:46.112652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be77d1-359b-408c-932f-109efaf2c3c4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:46.117699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:46.118375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:46.118662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:46.118973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:46.119714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:46.121368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:46.131899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1105/2203] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:46 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:46.136353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:46.147567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d9fca-dd96-49f2-ac89-6664625f4e95 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:46.152412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e21ed4-9f00-42cf-ba39-b1baa7823ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:46.153113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e21ed4-9f00-42cf-ba39-b1baa7823ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:46.153430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e21ed4-9f00-42cf-ba39-b1baa7823ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:46.153710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e21ed4-9f00-42cf-ba39-b1baa7823ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:46.154499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e21ed4-9f00-42cf-ba39-b1baa7823ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:46.156118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e21ed4-9f00-42cf-ba39-b1baa7823ee1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:46.167443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1099/2204] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:46 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:46.171969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:46.182922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788af4db-728e-42a3-9ccc-8592b1bc5ec8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:46.189601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:46.190473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:46.190759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:46.191038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] PATH_INFO: `/v3/projects/5230f81eb9524b769aabf551ff2fb773/users/e302f3c0beab46828fa98ff0cea7f967/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:46.208021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5230f81eb9524b769aabf551ff2fb773, user_id=e302f3c0beab46828fa98ff0cea7f967, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:46.211270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:46.227055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1106/2205] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:46 2022] PUT /identity/v3/projects/5230f81eb9524b769aabf551ff2fb773/users/e302f3c0beab46828fa98ff0cea7f967/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:46.238880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:46.239336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:46.239791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:46.275584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] MFA Rules not processed for user `e302f3c0beab46828fa98ff0cea7f967`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:46.276826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:46.350240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1100/2206] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:46.363882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:46.365821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:46.431717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade521-2b0d-40aa-bf6c-2b9a3e434cba admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:46.438359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126474f7-f01b-45db-871b-0c4a89ec8a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:46.439106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126474f7-f01b-45db-871b-0c4a89ec8a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:46.439300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126474f7-f01b-45db-871b-0c4a89ec8a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:46.439600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126474f7-f01b-45db-871b-0c4a89ec8a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:46.450417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126474f7-f01b-45db-871b-0c4a89ec8a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:46.451968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126474f7-f01b-45db-871b-0c4a89ec8a3e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:46.462880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1107/2207] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:46.955467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:46.957482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:47.056542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d7a46-6246-4687-b8e0-350af0c9a39a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:47.062911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:47.064627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:47.064975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:47.065354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] PATH_INFO: `/v3/users/bd2ab5f8b7a142da9e3df0cb906e188d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:47.067916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2ab5f8b7a142da9e3df0cb906e188d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:47.070339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:47.138980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2ab5f8b7a142da9e3df0cb906e188d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:47.139925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2ab5f8b7a142da9e3df0cb906e188d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:47.142153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2ab5f8b7a142da9e3df0cb906e188d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:47.149312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:47.165707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2ab5f8b7a142da9e3df0cb906e188d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:47.176362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2ab5f8b7a142da9e3df0cb906e188d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:47.192020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1101/2208] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:46 2022] DELETE /identity/v3/users/bd2ab5f8b7a142da9e3df0cb906e188d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:47.196928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:47.197499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:47.197853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:47.220346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:47.221840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:47.231075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:47.301480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1108/2209] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:47.316865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:47.318553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:47.413438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aeeff-4bfb-4475-8c19-8b8d95859e65 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:47.417149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:47.417875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:47.418166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:47.418472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:47.429157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:47.430800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:47.442339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1102/2210] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:47.911881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:47.913573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:47.926473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6265-cb49-465d-be43-0762d0040053 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:47.933631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:47.934552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:47.934830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:47.935103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] PATH_INFO: `/v3/projects/640c49efccee4c0c8ada6d370cd3c23d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:47.936328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640c49efccee4c0c8ada6d370cd3c23d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:47.938423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:47.998075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640c49efccee4c0c8ada6d370cd3c23d', 'request_id': 'req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.007314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640c49efccee4c0c8ada6d370cd3c23d', 'request_id': 'req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.014340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640c49efccee4c0c8ada6d370cd3c23d', 'request_id': 'req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.027665 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] The token cache is being invalidate because project 640c49efccee4c0c8ada6d370cd3c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:48.028085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.028799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.030510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1109/2211] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:47 2022] DELETE /identity/v3/projects/640c49efccee4c0c8ada6d370cd3c23d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:48.034717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:48.045542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c93dc-2b81-4dfc-83ad-37d7aeb403db service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:48.128448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:48.129517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:48.129799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:48.130070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] PATH_INFO: `/v3/users/3bfc7b9ffb244a20a9230ec2f63e07d2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:48.131415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfc7b9ffb244a20a9230ec2f63e07d2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:48.133467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:48.234230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfc7b9ffb244a20a9230ec2f63e07d2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.235318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfc7b9ffb244a20a9230ec2f63e07d2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.236053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfc7b9ffb244a20a9230ec2f63e07d2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.262749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfc7b9ffb244a20a9230ec2f63e07d2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.269302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfc7b9ffb244a20a9230ec2f63e07d2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.270431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:48.290695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1103/2212] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:48 2022] DELETE /identity/v3/users/3bfc7b9ffb244a20a9230ec2f63e07d2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:48.619685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:48.621585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:48.639114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70492ed-f5d2-4242-a01a-f69f96cb8ba8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:48.706073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:48.706865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:48.707180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:48.707458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] PATH_INFO: `/v3/projects/35cd161d976d4eeebef05bd02efb91cb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:48.708684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cd161d976d4eeebef05bd02efb91cb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:48.710986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:48.754431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:48.764748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cd161d976d4eeebef05bd02efb91cb', 'request_id': 'req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.773853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cd161d976d4eeebef05bd02efb91cb', 'request_id': 'req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.779697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cd161d976d4eeebef05bd02efb91cb', 'request_id': 'req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.791698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] The token cache is being invalidate because project 35cd161d976d4eeebef05bd02efb91cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:48.791980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.792666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.794280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1110/2213] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:48 2022] DELETE /identity/v3/projects/35cd161d976d4eeebef05bd02efb91cb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:48.798591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:48.800102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:48.819353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ce1c8-2179-4884-8b83-8a63baf9ffe2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:48.910961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:48.911210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:48.911306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:48.911775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] PATH_INFO: `/v3/users/8cb0c0f1a3154ed5acf07f9120493d0b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:48.913596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb0c0f1a3154ed5acf07f9120493d0b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:48.916824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:48.974248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb0c0f1a3154ed5acf07f9120493d0b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.975002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb0c0f1a3154ed5acf07f9120493d0b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.975688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb0c0f1a3154ed5acf07f9120493d0b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:48.992156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb0c0f1a3154ed5acf07f9120493d0b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.002384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb0c0f1a3154ed5acf07f9120493d0b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.022794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1104/2214] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:48 2022] DELETE /identity/v3/users/8cb0c0f1a3154ed5acf07f9120493d0b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:49.290935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:49.292924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.344201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d5851-200d-46a1-a0f6-e6f000a5bc41 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:49.367772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:49.369343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.484166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:49.485043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.485573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.486220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] PATH_INFO: `/v3/users/e302f3c0beab46828fa98ff0cea7f967` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.487901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e302f3c0beab46828fa98ff0cea7f967)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:49.489432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e91f26-4895-4b11-8fe9-c8bb5810ede4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:49.489577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:49.497376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:49.498552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.499738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.500626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] PATH_INFO: `/v3/users/f3428ce791674b949ae8d47637871374` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.505069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3428ce791674b949ae8d47637871374)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:49.508268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:49.529250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:49.568671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e302f3c0beab46828fa98ff0cea7f967'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.594753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e302f3c0beab46828fa98ff0cea7f967'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.597576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e302f3c0beab46828fa98ff0cea7f967'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.611112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e302f3c0beab46828fa98ff0cea7f967'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.611937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e302f3c0beab46828fa98ff0cea7f967'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.612479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3428ce791674b949ae8d47637871374'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.613860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3428ce791674b949ae8d47637871374'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.615597 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3428ce791674b949ae8d47637871374'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.629868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1111/2215] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:49 2022] DELETE /identity/v3/users/e302f3c0beab46828fa98ff0cea7f967 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:49.633249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:49.633249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.637069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3428ce791674b949ae8d47637871374'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.646384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2c3b7b38-6c94-4d26-abb3-028c79d54ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3428ce791674b949ae8d47637871374'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.667042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1105/2216] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:49 2022] DELETE /identity/v3/users/f3428ce791674b949ae8d47637871374 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:49.667042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2ee9-694e-4dbe-8268-70732fdf7287 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.667042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2ee9-694e-4dbe-8268-70732fdf7287 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.667042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2ee9-694e-4dbe-8268-70732fdf7287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.686025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:49.686258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-df9e2ee9-694e-4dbe-8268-70732fdf7287 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:49.687503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df9e2ee9-694e-4dbe-8268-70732fdf7287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.705050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a734e-cd18-4c0b-bdfa-ab156033c9c9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:49.755369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1106/2217] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:49.756683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.756992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.757294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.777245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:49.777491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:49.778275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.778477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.778613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.778822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] PATH_INFO: `/v3/projects/d01dd27ab7bf4c7893545059d3fe4052` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.779983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01dd27ab7bf4c7893545059d3fe4052)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:49.782130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:49.786910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1107/2218] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:49.787826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:49.789096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.831277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01dd27ab7bf4c7893545059d3fe4052', 'request_id': 'req-06738347-e125-469f-8369-614cc24828f6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.840375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01dd27ab7bf4c7893545059d3fe4052', 'request_id': 'req-06738347-e125-469f-8369-614cc24828f6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.846851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01dd27ab7bf4c7893545059d3fe4052', 'request_id': 'req-06738347-e125-469f-8369-614cc24828f6'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.847610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0d53c-8f0a-4f47-aca0-c7dac6172b33 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:49.862695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] The token cache is being invalidate because project d01dd27ab7bf4c7893545059d3fe4052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:49.863427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.864527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:49.867326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1112/2219] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:49 2022] DELETE /identity/v3/projects/d01dd27ab7bf4c7893545059d3fe4052 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:49.868998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:49.870854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.884005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:49.902418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:49.903227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.903566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.904731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.907542 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.937592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738347-e125-469f-8369-614cc24828f6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:49.943071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:49.943762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.944040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.944316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:49.946176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:49.981818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:49.983320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7a40-8d24-4208-9cb8-d64424350fae service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:49.995489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1108/2220] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:49.996828 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7a56d-b774-4246-979a-d3ffe7e3f9a5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:49.997133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7a56d-b774-4246-979a-d3ffe7e3f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:49.997424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7a56d-b774-4246-979a-d3ffe7e3f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.001620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:50.021717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-48c7a56d-b774-4246-979a-d3ffe7e3f9a5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:50.022955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-48c7a56d-b774-4246-979a-d3ffe7e3f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:50.037255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1109/2221] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:50.039687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.041361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.050029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.050384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.050667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.056849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1113/2222] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:50.093618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:50.096678 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:50.112892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1110/2223] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:50.117972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.138774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db041-c166-4942-819c-dc065dc09fbb service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.146348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.147052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.147391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.147682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.148498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:50.148849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.151040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.179257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1114/2224] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:50.184602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.217374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05251-87c8-417d-9678-3608476e60e1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.228016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.228797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.229485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.229598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.230372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.233885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.276341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1111/2225] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:50 2022] POST /identity/v3/projects => generated 368 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:50.281176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.297195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c49242-9743-4163-ab9d-b7019403ec2d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.394349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.396964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:50.410792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.411682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.411965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.413166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.413762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.415915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.459717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1115/2226] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:50 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:50.461224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.474794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195323c-0a1f-4f6c-9a6a-f0628139e3e5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.486177 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.487419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.487521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.487786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.488478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.490725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.506430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1116/2227] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:50 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:50.511312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.526955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638b113-1210-4c8f-a0d4-2e4f1096314a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.530456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e47e-5fb9-477e-80f2-86f5aa226dc1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.536403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.537380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.537667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.537916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.538064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.538996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.539129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.539864 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.540277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] PATH_INFO: `/v3/projects/5230f81eb9524b769aabf551ff2fb773` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.540864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.542125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5230f81eb9524b769aabf551ff2fb773)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.544957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.574947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1117/2228] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:50 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:50.574947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.575678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:50.592833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd144e22-0b34-45fb-b2cf-57d48c9a28fd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.598738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.599726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.600067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.600386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] PATH_INFO: `/v3/projects/9abb9d142d0d40e99a304c2a2517948a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.601767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abb9d142d0d40e99a304c2a2517948a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.603893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.613584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5230f81eb9524b769aabf551ff2fb773', 'request_id': 'req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.617959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:50.624880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5230f81eb9524b769aabf551ff2fb773', 'request_id': 'req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.632693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5230f81eb9524b769aabf551ff2fb773', 'request_id': 'req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.645099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] The token cache is being invalidate because project 5230f81eb9524b769aabf551ff2fb773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:50.645429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.646103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.647747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1112/2229] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:50 2022] DELETE /identity/v3/projects/5230f81eb9524b769aabf551ff2fb773 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:50.648492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.649834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:50.659555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abb9d142d0d40e99a304c2a2517948a', 'request_id': 'req-a9166628-662b-40cd-b112-6af0fee03860'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.668240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abb9d142d0d40e99a304c2a2517948a', 'request_id': 'req-a9166628-662b-40cd-b112-6af0fee03860'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.676645 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abb9d142d0d40e99a304c2a2517948a', 'request_id': 'req-a9166628-662b-40cd-b112-6af0fee03860'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.691336 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] The token cache is being invalidate because project 9abb9d142d0d40e99a304c2a2517948a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:50.691680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.692518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.697449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1118/2230] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:50 2022] DELETE /identity/v3/projects/9abb9d142d0d40e99a304c2a2517948a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:50.698762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:50.701011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:50.719129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:50.784832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d589d-7cbe-4b6c-82ab-4330a5f10d04 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.804883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9166628-662b-40cd-b112-6af0fee03860 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:50.813966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.815361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.815783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.816190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] PATH_INFO: `/v3/users/5ae0dede920049d09b94eda03ebad675` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.818740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae0dede920049d09b94eda03ebad675)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.822234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.865998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219912d-4c59-4c40-bc75-d9f7ea41d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:50.866939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219912d-4c59-4c40-bc75-d9f7ea41d4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.867266 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219912d-4c59-4c40-bc75-d9f7ea41d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.867576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219912d-4c59-4c40-bc75-d9f7ea41d4f8 admin admin] PATH_INFO: `/v3/projects/913393bf08e94d5d8b464bc2f3e16340/users/d41bbfcb24c947cfa52364ea78fbb4d1/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.888400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219912d-4c59-4c40-bc75-d9f7ea41d4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913393bf08e94d5d8b464bc2f3e16340, user_id=d41bbfcb24c947cfa52364ea78fbb4d1, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:50.891285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219912d-4c59-4c40-bc75-d9f7ea41d4f8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:50.893505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae0dede920049d09b94eda03ebad675'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.917175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae0dede920049d09b94eda03ebad675'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.919001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae0dede920049d09b94eda03ebad675'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.925432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1113/2231] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:50 2022] PUT /identity/v3/projects/913393bf08e94d5d8b464bc2f3e16340/users/d41bbfcb24c947cfa52364ea78fbb4d1/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:50.938434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae0dede920049d09b94eda03ebad675'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.938830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:50.939136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:50.939355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae0dede920049d09b94eda03ebad675'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:50.939476 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:50.962649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1119/2232] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:50 2022] DELETE /identity/v3/users/5ae0dede920049d09b94eda03ebad675 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:50.977915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] MFA Rules not processed for user `d41bbfcb24c947cfa52364ea78fbb4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:50.979176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.051217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1114/2233] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:51.055800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.057380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.142899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c58b-def3-42bf-954a-015d60977185 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.148245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.148938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.149260 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.149541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.150275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.152225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.185535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1120/2234] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/projects => generated 368 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:51.190231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.196065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:51.203784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837743-aa56-4003-b013-bf7217a07969 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.269681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.270302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.270588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.270870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.271225 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.271630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.273624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.273902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.290096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a355-5128-4cfa-8d73-e2401f9dcca2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.299512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1115/2235] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:51.300296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.301351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.301646 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.301994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] PATH_INFO: `/v3/projects/0be919fd099d439c865b7cd0524c8456` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.303301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be919fd099d439c865b7cd0524c8456)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.304177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.305415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.315267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d4b7e-4380-4843-b1d3-db904528a780 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.318310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:51.321757 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.322451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.322736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.323018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.323777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.325429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.336878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1116/2236] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:20:51.341519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.352627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0e26-7b4f-42ba-8970-3161202f045c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.362494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be919fd099d439c865b7cd0524c8456', 'request_id': 'req-54750a56-6aa7-41d3-9043-f927ac3a1000'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:51.371043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be919fd099d439c865b7cd0524c8456', 'request_id': 'req-54750a56-6aa7-41d3-9043-f927ac3a1000'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:51.384054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be919fd099d439c865b7cd0524c8456', 'request_id': 'req-54750a56-6aa7-41d3-9043-f927ac3a1000'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:51.402966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] The token cache is being invalidate because project 0be919fd099d439c865b7cd0524c8456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:51.403264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:51.403958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-54750a56-6aa7-41d3-9043-f927ac3a1000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:51.405636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1121/2237] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:51 2022] DELETE /identity/v3/projects/0be919fd099d439c865b7cd0524c8456 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:51.411637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7aa13-8525-4981-8f61-5bcb2467216d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.411922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7aa13-8525-4981-8f61-5bcb2467216d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.412198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7aa13-8525-4981-8f61-5bcb2467216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.419064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.420067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.420354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.420671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] PATH_INFO: `/v3/projects/6e6ac76f93534e2ead99726998d198a4/users/19642d43b904471c8850fb90210392cf/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.432934 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2cf7aa13-8525-4981-8f61-5bcb2467216d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:51.434201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2cf7aa13-8525-4981-8f61-5bcb2467216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.436980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6ac76f93534e2ead99726998d198a4, user_id=19642d43b904471c8850fb90210392cf, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.439898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.445629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1122/2238] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:51.451305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.451596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.451925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.462187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1117/2239] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:51 2022] PUT /identity/v3/projects/6e6ac76f93534e2ead99726998d198a4/users/19642d43b904471c8850fb90210392cf/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:51.467152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.468944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.475980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:51.477639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.585708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1123/2240] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:51.587494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a5df4-4449-4705-a26f-b8c5c2ffae58 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.592867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.593902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.595071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.595508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.595854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.596711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.598871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.601732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f629-b2b6-4c55-88bd-618bf6607bb6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.604841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:51.607695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.608882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.608882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.609406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.610603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:51.611218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.611837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1118/2241] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:51.615768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.617593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.628642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e318f-4733-43d3-bbd2-3228e33eb7c6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.634194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738286e5-f272-416b-b169-69d6e3941c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.635289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738286e5-f272-416b-b169-69d6e3941c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.635648 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738286e5-f272-416b-b169-69d6e3941c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.636005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738286e5-f272-416b-b169-69d6e3941c61 admin admin] PATH_INFO: `/v3/projects/6e6ac76f93534e2ead99726998d198a4/users/19642d43b904471c8850fb90210392cf/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.636172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1124/2242] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:20:51.636876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.638505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738286e5-f272-416b-b169-69d6e3941c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6ac76f93534e2ead99726998d198a4, user_id=19642d43b904471c8850fb90210392cf, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.642516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738286e5-f272-416b-b169-69d6e3941c61 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.649302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f507-d388-42a1-9f12-94c82cb14c03 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.666491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1119/2243] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:51 2022] PUT /identity/v3/projects/6e6ac76f93534e2ead99726998d198a4/users/19642d43b904471c8850fb90210392cf/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:51.670977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.671302 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.671583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.704612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] MFA Rules not processed for user `19642d43b904471c8850fb90210392cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:51.705994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.739927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.741929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.742466 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.742974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.744060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.747373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.821355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1125/2244] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/projects => generated 388 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:51.826404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.833496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:51.864898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1120/2245] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:51.877328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:51.879687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:51.946230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7912a-f24d-4d10-aa41-fdc2ddf7e8b8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.954906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7016e68-f536-4dff-9ea5-0c6bd312c09c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:51.960624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:51.961452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:51.961682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:51.962031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:51.963412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:51.966010 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:51.994649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1126/2246] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:51 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:52.000202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.010028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdd26e-47e8-4dcb-b53c-daf7974d38f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.010550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6be1-7f4f-4282-98eb-fd91d051d837 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.011870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd26e-47e8-4dcb-b53c-daf7974d38f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.012463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd26e-47e8-4dcb-b53c-daf7974d38f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.012988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd26e-47e8-4dcb-b53c-daf7974d38f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.015435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.016114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.016487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.016972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.017806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.019756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.043229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1127/2247] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:52.045888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.059827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f14f0-aef9-40d7-8106-87deeed1ee35 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.064862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.065516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.065800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.066080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.066819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.068449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.081184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1128/2248] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:52 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:52.084378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.085698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:52.100194 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318dfd-8284-494e-8f5a-056c914d55e2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.105242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.106154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.106435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.106710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] PATH_INFO: `/v3/projects/1a8d18e5817b4a1394f19cc5205e314a/users/faab7cc5c4714475ae5c9fb0969bac87/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.111090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdd26e-47e8-4dcb-b53c-daf7974d38f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.112782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdd26e-47e8-4dcb-b53c-daf7974d38f3 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.124296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1121/2249] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:52.124597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8d18e5817b4a1394f19cc5205e314a, user_id=faab7cc5c4714475ae5c9fb0969bac87, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.128065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.145392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1129/2250] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:52 2022] PUT /identity/v3/projects/1a8d18e5817b4a1394f19cc5205e314a/users/faab7cc5c4714475ae5c9fb0969bac87/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:52.157855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.158227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.158515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.199111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] MFA Rules not processed for user `faab7cc5c4714475ae5c9fb0969bac87`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:52.200529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:52.246864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.297747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1122/2251] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:52.303458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.322941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603d88b-16f0-46b1-96bf-0ff7a5bd5c9a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.329768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.330473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.330754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.331026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.333541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:52.392059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1fd71-aa0f-413f-a985-6e0bd7a991eb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.398276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.398977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.399256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.399535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.401364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.404113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.434606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.437564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.442373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1123/2252] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:52 2022] POST /identity/v3/projects => generated 388 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:52.443482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.457306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1130/2253] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:52.509371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:52.525310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff5ed3-2374-400c-a41a-7d1c4098362d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.531201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.531941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.532230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.532511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.533256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.535220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.577091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1124/2254] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:52 2022] POST /identity/v3/users => generated 301 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:52.582350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.592020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:52.600499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502013-5f6a-41fa-8775-9bd33083d7e1 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.608188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.608963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.609301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.609581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.610415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.612068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.623692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1131/2255] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:52 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:52.628435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.639677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99995a2-e7d5-472b-a521-b2a2beea1853 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.648360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.649457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.649845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.650239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] PATH_INFO: `/v3/projects/ae9f9848eb4c420e8699aa93868fb643/users/5853f3d9b41f48f99a8f41637f004a3a/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.669470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9f9848eb4c420e8699aa93868fb643, user_id=5853f3d9b41f48f99a8f41637f004a3a, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.672425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.691070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1125/2256] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:52 2022] PUT /identity/v3/projects/ae9f9848eb4c420e8699aa93868fb643/users/5853f3d9b41f48f99a8f41637f004a3a/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:52.691801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.703601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68853d3a-659c-4b8f-9015-008f2376f194 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.774874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a24bc-88b5-43e5-8444-5072e77a5622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.776310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a24bc-88b5-43e5-8444-5072e77a5622 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.776809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a24bc-88b5-43e5-8444-5072e77a5622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.777256 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a24bc-88b5-43e5-8444-5072e77a5622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.778197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a24bc-88b5-43e5-8444-5072e77a5622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.780434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a24bc-88b5-43e5-8444-5072e77a5622 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.792440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1132/2257] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:52 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:20:52.796293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.807551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b5e07-73d5-47cb-8a8e-d673a7c9abc9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.812821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.813877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.814227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.814570 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] PATH_INFO: `/v3/projects/ae9f9848eb4c420e8699aa93868fb643/users/5853f3d9b41f48f99a8f41637f004a3a/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.816800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9f9848eb4c420e8699aa93868fb643, user_id=5853f3d9b41f48f99a8f41637f004a3a, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.819642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.837179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1126/2258] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:52 2022] PUT /identity/v3/projects/ae9f9848eb4c420e8699aa93868fb643/users/5853f3d9b41f48f99a8f41637f004a3a/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:52.844098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.844396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.845089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.894267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] MFA Rules not processed for user `5853f3d9b41f48f99a8f41637f004a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:52.894489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.896030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:52.896399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:52.975839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aaa28-268a-4fa1-816f-0698d699f9f6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:52.980703 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:52.981623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:52.981900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:52.982168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] PATH_INFO: `/v3/users/e81883bdbd1645608248b2b8d9140479` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:52.982647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1133/2259] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:52.983421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81883bdbd1645608248b2b8d9140479)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:52.985695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:52.995732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:52.997414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.041684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81883bdbd1645608248b2b8d9140479'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.042574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81883bdbd1645608248b2b8d9140479'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.043637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81883bdbd1645608248b2b8d9140479'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.063372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78483f98-ce9a-4a77-b7a4-0361921cfc83 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:53.066544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81883bdbd1645608248b2b8d9140479'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.067799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:53.068303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.068577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.068856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.070758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.076583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c80c7be2-cab4-46cb-b5aa-0065eb59fee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81883bdbd1645608248b2b8d9140479'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.086126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:53.087594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:53.094859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1127/2260] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:52 2022] DELETE /identity/v3/users/e81883bdbd1645608248b2b8d9140479 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:53.098817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1134/2261] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:53.099580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.099777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.100179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.123250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:53.124460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.129939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:53.131531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.146677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:53.148087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49986b2e-ecbe-40bd-bbe1-3f7fb413899e service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:53.164983 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:53.212328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1128/2262] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:53.223186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:53.225946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.228808 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:53.229850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.230199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.230542 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] PATH_INFO: `/v3/users/faab7cc5c4714475ae5c9fb0969bac87` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.231937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faab7cc5c4714475ae5c9fb0969bac87)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:53.234867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:53.306153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faab7cc5c4714475ae5c9fb0969bac87'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.323638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faab7cc5c4714475ae5c9fb0969bac87'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.324667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faab7cc5c4714475ae5c9fb0969bac87'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.330220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c08dc-5370-4cad-a405-52f9d79457ec None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:53.337002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:53.337399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faab7cc5c4714475ae5c9fb0969bac87'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.338202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f2564c-b10f-4c6b-8edc-079b5e48bce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faab7cc5c4714475ae5c9fb0969bac87'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.338978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.339412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.339938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.342182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.358709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:53.360936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:53.364290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1135/2263] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:53 2022] DELETE /identity/v3/users/faab7cc5c4714475ae5c9fb0969bac87 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:53.369155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.369693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.370127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.373049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1129/2264] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:53.394081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:53.395372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.496534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1136/2265] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:53.521427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:53.524297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.552584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739438bc-de35-4ff6-9ca1-d87217171b2c service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:53.620236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b11f9e-f1d5-4064-80c7-7a6c2c98d590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:53.620948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11f9e-f1d5-4064-80c7-7a6c2c98d590 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.621310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11f9e-f1d5-4064-80c7-7a6c2c98d590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.621593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b11f9e-f1d5-4064-80c7-7a6c2c98d590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.631623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b11f9e-f1d5-4064-80c7-7a6c2c98d590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:53.633189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b11f9e-f1d5-4064-80c7-7a6c2c98d590 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:53.643232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1130/2266] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:53.715606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:53.717188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.732552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e8b0e-a848-4c16-bab5-30623409594d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:53.739840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:53.741257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.741585 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.741890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] PATH_INFO: `/v3/projects/f80c07e08c084d93a7020d4ab0b4eef7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.743229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80c07e08c084d93a7020d4ab0b4eef7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:53.746335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:53.794722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:53.811896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80c07e08c084d93a7020d4ab0b4eef7', 'request_id': 'req-c3a24b20-e914-43cb-bd57-f4c4796f9e72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.822071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80c07e08c084d93a7020d4ab0b4eef7', 'request_id': 'req-c3a24b20-e914-43cb-bd57-f4c4796f9e72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.829170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80c07e08c084d93a7020d4ab0b4eef7', 'request_id': 'req-c3a24b20-e914-43cb-bd57-f4c4796f9e72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.844905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] The token cache is being invalidate because project f80c07e08c084d93a7020d4ab0b4eef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:53.845157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.845891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c3a24b20-e914-43cb-bd57-f4c4796f9e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:53.847636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1137/2267] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:53 2022] DELETE /identity/v3/projects/f80c07e08c084d93a7020d4ab0b4eef7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:53.853102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.854220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.854220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.883629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:53.884244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:53.980827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1131/2268] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:53.990037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:53.990325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:53.990656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:53.996701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:53.998127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.013548 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdae8ac-4ade-4bb5-b618-7c6c726c8238 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.020038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.021101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.021486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.021911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] PATH_INFO: `/v3/projects/1a8d18e5817b4a1394f19cc5205e314a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.023323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8d18e5817b4a1394f19cc5205e314a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.024591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:54.026099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.033704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.037293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:54.044079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1138/2269] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:54.048458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.061817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d52a2-1ad6-441e-bd4b-3b9eb19b3204 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.069669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.070482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.070767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.071043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.071918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:54.072330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.074372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.091483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1139/2270] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:20:54.092474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.102481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8d18e5817b4a1394f19cc5205e314a', 'request_id': 'req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.105019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c541-5b30-42c2-93e6-e6407ae033f6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.120320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8d18e5817b4a1394f19cc5205e314a', 'request_id': 'req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.130427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8d18e5817b4a1394f19cc5205e314a', 'request_id': 'req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.148277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] The token cache is being invalidate because project 1a8d18e5817b4a1394f19cc5205e314a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:54.148755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.149982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.152050 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1132/2271] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:53 2022] DELETE /identity/v3/projects/1a8d18e5817b4a1394f19cc5205e314a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:54.158690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.161205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.217054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.218732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.220480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.220969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.222715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.226192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.247316 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ad5d-a1cd-48e6-b3a9-a153bd26d574 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.254411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.255594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.255937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.256212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] PATH_INFO: `/v3/users/5853f3d9b41f48f99a8f41637f004a3a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.257763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5853f3d9b41f48f99a8f41637f004a3a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.259808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.273486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1140/2272] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:54 2022] POST /identity/v3/projects => generated 392 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:54.274135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.276718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.321822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5853f3d9b41f48f99a8f41637f004a3a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.322512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5853f3d9b41f48f99a8f41637f004a3a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.323346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5853f3d9b41f48f99a8f41637f004a3a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.338917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5853f3d9b41f48f99a8f41637f004a3a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.348100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5853f3d9b41f48f99a8f41637f004a3a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.360840 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1133/2273] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:54 2022] DELETE /identity/v3/users/5853f3d9b41f48f99a8f41637f004a3a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:54.363230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193d634-48b0-42d2-a4be-7d7ac8ae7dbf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.411306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:54.452514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.453237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.453680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.454130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.454987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.457282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.486441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1141/2274] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:54 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:54.490868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.493187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.508116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b5e3-a71a-43b1-848f-fdc3e1944f50 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.514178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.514985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.515149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.515428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.516372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.518284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.535255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1134/2275] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:54 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:54.536653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.549588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f814f-30e8-4164-8722-40c808c083d3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.558465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f991dbe-8ad4-47d4-ab37-c0d44faf78f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.559783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f991dbe-8ad4-47d4-ab37-c0d44faf78f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.560362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f991dbe-8ad4-47d4-ab37-c0d44faf78f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.561660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f991dbe-8ad4-47d4-ab37-c0d44faf78f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.563186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f991dbe-8ad4-47d4-ab37-c0d44faf78f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.566441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f991dbe-8ad4-47d4-ab37-c0d44faf78f4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.578406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1142/2276] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:54 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:54.586239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.591958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:54.598166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b58fa8-f389-49f3-9e08-34218533a1f8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.604237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.605277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.606512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.606512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] PATH_INFO: `/v3/projects/52c10f7d5d7c41b88802a28065c3ce6e/users/ff06e7822ca44cd2b66978cf91ebcc2d/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.638729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c10f7d5d7c41b88802a28065c3ce6e, user_id=ff06e7822ca44cd2b66978cf91ebcc2d, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.642101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.674546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1135/2277] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:54 2022] PUT /identity/v3/projects/52c10f7d5d7c41b88802a28065c3ce6e/users/ff06e7822ca44cd2b66978cf91ebcc2d/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:54.684833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.685180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.685437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.733381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] MFA Rules not processed for user `ff06e7822ca44cd2b66978cf91ebcc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:54.734909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.763451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.766074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.842189 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1143/2278] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:54.862009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:54.863388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:54.873639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da4fe4-ae46-4cdd-ab20-3ac90c192393 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.880910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:54.882009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.882295 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.882571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] PATH_INFO: `/v3/projects/ae9f9848eb4c420e8699aa93868fb643` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:54.883916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9f9848eb4c420e8699aa93868fb643)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:54.886898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:54.942604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9f9848eb4c420e8699aa93868fb643', 'request_id': 'req-5e1f062d-5c25-4208-b777-39f7e9e82d02'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.957092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9f9848eb4c420e8699aa93868fb643', 'request_id': 'req-5e1f062d-5c25-4208-b777-39f7e9e82d02'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.957990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38034eb-ff67-4d35-b125-52e89752b232 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:54.966891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9f9848eb4c420e8699aa93868fb643', 'request_id': 'req-5e1f062d-5c25-4208-b777-39f7e9e82d02'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.983838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] The token cache is being invalidate because project ae9f9848eb4c420e8699aa93868fb643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:54.984135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.985923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5e1f062d-5c25-4208-b777-39f7e9e82d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:54.988497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1136/2279] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:54 2022] DELETE /identity/v3/projects/ae9f9848eb4c420e8699aa93868fb643 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:54.994397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2ad4-04df-4551-b927-1e4db97afb50 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:54.994763 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2ad4-04df-4551-b927-1e4db97afb50 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:54.995113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2ad4-04df-4551-b927-1e4db97afb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.024845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0c7a2ad4-04df-4551-b927-1e4db97afb50 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:55.026195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c7a2ad4-04df-4551-b927-1e4db97afb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:55.026941 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.027851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.028132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.028408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.030467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:55.043150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:55.096254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1137/2280] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:20:55.105384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.105759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.106116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.107730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.110292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.120753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1144/2281] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:55.128691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:55.130023 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:55.140290 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1138/2282] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:55.144664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.157070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa3488-b135-4434-8443-42c924eef950 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.163102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.164068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.164605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.164916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.165907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:55.166219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.168426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.189355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1145/2283] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:55.194515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.201748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:55.210215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00b809-99f2-4f05-8934-abe89913d162 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.219450 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.220286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.220993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.220993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.222084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.224492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.260655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1139/2284] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:55 2022] POST /identity/v3/projects => generated 402 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:55.265572 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.284710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c390-9d70-43f0-921c-6c051009bbe0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.417444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.418266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.418605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.418958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.419791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.422382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.464519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1146/2285] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:55 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:55.468922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.483636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f25207-ad6d-4fd4-96ee-7a73b324b188 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.492201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.493366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.493655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.493929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.494671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.496404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.509431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1140/2286] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:55 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:55.514059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.526109 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966563e-a2ab-4365-9d0a-82e8a2c9c32f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.531133 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686950-f7ef-4650-a428-71018ed5a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.532648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686950-f7ef-4650-a428-71018ed5a422 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.533075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686950-f7ef-4650-a428-71018ed5a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.533406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686950-f7ef-4650-a428-71018ed5a422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.534556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686950-f7ef-4650-a428-71018ed5a422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.536651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686950-f7ef-4650-a428-71018ed5a422 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.553185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1147/2287] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:55 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:55.554898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.565578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744a01-e622-4da4-ae78-4e8def061d5d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.570263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.571191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.571483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.571951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] PATH_INFO: `/v3/projects/ba0637c1f98a48f2bbd96289bd0ab312/users/72c50d10eeba4f11acde5a4b635c8574/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.588790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0637c1f98a48f2bbd96289bd0ab312, user_id=72c50d10eeba4f11acde5a4b635c8574, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.591513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.605811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1141/2288] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:55 2022] PUT /identity/v3/projects/ba0637c1f98a48f2bbd96289bd0ab312/users/72c50d10eeba4f11acde5a4b635c8574/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:55.616288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.616582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.616864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.645842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] MFA Rules not processed for user `72c50d10eeba4f11acde5a4b635c8574`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:55.646995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:55.735374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1148/2289] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:55.739924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.813379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9101-e060-4c02-bbd0-fba1e55add6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.819332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.820148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.820431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.820707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.821654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.823372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.856129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1142/2290] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:55 2022] POST /identity/v3/projects => generated 402 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:20:55.860506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.868050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:55.873219 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd433-ea49-45de-b118-7ab2e63ca625 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.943860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.944547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.944833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.945155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.945877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.947918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:55.973872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1149/2291] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:20:55 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:20:55.978057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:55.989656 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6182c-5070-4633-bbc7-0278d2071f2d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:55.994342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:55.995018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:55.995310 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:55.995576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:55.996639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:55.998284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:56.010473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1143/2292] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:55 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:56.015479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:56.027823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22849b9-04ef-46db-af1b-8e4708572f48 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:56.037636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:56.037636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:56.037636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:56.037636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] PATH_INFO: `/v3/projects/ab0fcfb073904e2a8c7741060ea368c0/users/b00240975cf744d99f31f9abc172644e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:56.051656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fcfb073904e2a8c7741060ea368c0, user_id=b00240975cf744d99f31f9abc172644e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:56.054757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:56.080978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1150/2293] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:56 2022] PUT /identity/v3/projects/ab0fcfb073904e2a8c7741060ea368c0/users/b00240975cf744d99f31f9abc172644e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:56.081089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:56.093616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675ee8-d9a2-44ac-922d-27be63418c89 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:56.154592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd43b2d-7864-4c12-81e8-677aeb05d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:56.155372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43b2d-7864-4c12-81e8-677aeb05d6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:56.155658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43b2d-7864-4c12-81e8-677aeb05d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:56.155937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43b2d-7864-4c12-81e8-677aeb05d6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:56.156781 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd43b2d-7864-4c12-81e8-677aeb05d6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:56.158612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd43b2d-7864-4c12-81e8-677aeb05d6ec admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:56.170062 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1144/2294] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:20:56 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:20:56.175208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:56.186396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4d28-bf0e-459f-9796-b3f8015107b7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:56.191546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:56.192517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:56.192796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:56.193238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] PATH_INFO: `/v3/projects/ab0fcfb073904e2a8c7741060ea368c0/users/b00240975cf744d99f31f9abc172644e/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:56.195239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fcfb073904e2a8c7741060ea368c0, user_id=b00240975cf744d99f31f9abc172644e, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:56.197959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:56.213649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1151/2295] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:20:56 2022] PUT /identity/v3/projects/ab0fcfb073904e2a8c7741060ea368c0/users/b00240975cf744d99f31f9abc172644e/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:56.224255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:56.224577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:56.224895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:56.255157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] MFA Rules not processed for user `b00240975cf744d99f31f9abc172644e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:56.256370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:56.260608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:56.336879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1145/2296] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:56.348116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:56.350153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:56.433555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc09b06-ecbd-4d41-8611-954acc8354d0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:56.437918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:56.438786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:56.439137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:56.439403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:56.451086 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:56.452574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:56.464378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1152/2297] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:56.589225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:56.600234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f447ab-e5dd-4684-9b94-a1cfdb0a13fd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:56.607605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d063d-9825-4404-a78f-711044338b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:56.608504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d063d-9825-4404-a78f-711044338b7a service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:56.608810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d063d-9825-4404-a78f-711044338b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:56.609368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d063d-9825-4404-a78f-711044338b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:56.688170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d063d-9825-4404-a78f-711044338b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:56.691034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d063d-9825-4404-a78f-711044338b7a service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:56.706867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1146/2298] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:56 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:57.765826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:57.767343 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:57.840172 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400bd85-5313-4a30-b1e3-d115cbb8071b service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:57.846403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:57.847371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:57.847685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:57.848268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] PATH_INFO: `/v3/users/d41bbfcb24c947cfa52364ea78fbb4d1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:57.849662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41bbfcb24c947cfa52364ea78fbb4d1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:57.851672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:57.853520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:57.935143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41bbfcb24c947cfa52364ea78fbb4d1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:57.958396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41bbfcb24c947cfa52364ea78fbb4d1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:57.959529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41bbfcb24c947cfa52364ea78fbb4d1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:57.969414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41bbfcb24c947cfa52364ea78fbb4d1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:57.970627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41bbfcb24c947cfa52364ea78fbb4d1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:57.989187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1153/2299] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:57 2022] DELETE /identity/v3/users/d41bbfcb24c947cfa52364ea78fbb4d1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:57.993741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:57.994753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:57.995011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:58.026361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:58.028136 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:58.163315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1147/2300] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:58.175309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:58.177190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:58.254671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e0d5-e609-4951-98a2-90812f0c35d6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:58.260087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:58.261201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:58.261689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:58.262107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:58.279381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:58.282210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:58.298169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1154/2301] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:20:58.626441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:58.627976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:58.641847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6052af-f81e-46af-93f1-042d51764eb8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:58.652921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:58.654001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:58.654390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:58.654575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] PATH_INFO: `/v3/projects/913393bf08e94d5d8b464bc2f3e16340` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:58.655932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913393bf08e94d5d8b464bc2f3e16340)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:58.658191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:58.701059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:58.721653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913393bf08e94d5d8b464bc2f3e16340', 'request_id': 'req-5891d1a1-8158-4fd3-924f-4f80b536f7d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.732018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913393bf08e94d5d8b464bc2f3e16340', 'request_id': 'req-5891d1a1-8158-4fd3-924f-4f80b536f7d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.743142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913393bf08e94d5d8b464bc2f3e16340', 'request_id': 'req-5891d1a1-8158-4fd3-924f-4f80b536f7d4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.757575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] The token cache is being invalidate because project 913393bf08e94d5d8b464bc2f3e16340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:58.757812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.758637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5891d1a1-8158-4fd3-924f-4f80b536f7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.760487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1148/2302] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:58 2022] DELETE /identity/v3/projects/913393bf08e94d5d8b464bc2f3e16340 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:20:58.765406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:58.775850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b178522-9f3d-40f7-b933-c104c9ef1668 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:58.834388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:58.834989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:58.835296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:58.848562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:58.856576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:58.856775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] MFA Rules not processed for user `f99afdfcdd32429f88a03a06dd71453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:58.856876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:58.857297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] PATH_INFO: `/v3/users/19642d43b904471c8850fb90210392cf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:58.858394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:58.858703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19642d43b904471c8850fb90210392cf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:58.860716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:58.890958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:58.920246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19642d43b904471c8850fb90210392cf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.926929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1149/2303] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:58.934965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19642d43b904471c8850fb90210392cf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.935691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19642d43b904471c8850fb90210392cf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.945901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19642d43b904471c8850fb90210392cf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.946735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0f6e3204-7497-423f-a243-dd335bef476b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19642d43b904471c8850fb90210392cf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:58.962690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1155/2304] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:20:58 2022] DELETE /identity/v3/users/19642d43b904471c8850fb90210392cf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:59.310212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:59.313279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:59.338495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d6ad-3272-4d3e-be13-201000a52149 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:59.570594 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:59.571529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:59.571867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:59.572147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] PATH_INFO: `/v3/projects/6e6ac76f93534e2ead99726998d198a4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:59.573676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6ac76f93534e2ead99726998d198a4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:59.575879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:59.639268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6ac76f93534e2ead99726998d198a4', 'request_id': 'req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:59.650355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6ac76f93534e2ead99726998d198a4', 'request_id': 'req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:59.659210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6ac76f93534e2ead99726998d198a4', 'request_id': 'req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:59.669551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:59.678144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] The token cache is being invalidate because project 6e6ac76f93534e2ead99726998d198a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:20:59.678599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:59.679873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e6cc50e1-2193-4a03-887e-c13f2ca2ac4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:20:59.682074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1150/2305] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:20:59 2022] DELETE /identity/v3/projects/6e6ac76f93534e2ead99726998d198a4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:20:59.686948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:59.687255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:59.687694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:59.722142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:59.723412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:59.850406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1156/2306] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:59.864525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:59.864821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:59.865096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:59.888100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:59.889516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:59.899286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1151/2307] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:59.903743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:59.914642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5196-7375-4b5f-ae3c-9d643c2d44f0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:59.919345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:59.920016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:59.920300 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:59.920575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:59.921367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:20:59.921673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:59.923812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:20:59.936378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1157/2308] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:20:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:20:59.941336 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:20:59.951439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921573-44b1-41e7-877c-9140024ff8b5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:20:59.956323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:20:59.957073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:59.957538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:59.957861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:59.958658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:20:59.961197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:00.005194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1152/2309] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:20:59 2022] POST /identity/v3/projects => generated 372 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:00.009205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:00.020593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ca8e-6551-4923-9fad-a7cd9838781d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:00.107540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:00.108284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:00.108568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:00.108843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:00.109627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:00.111643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:00.134160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1158/2310] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:00 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:00.138730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:00.149515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91fb2-dcd2-4bfe-a620-ef71f66fdd59 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:00.154162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:00.154834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:00.155116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:00.155391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:00.156125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:00.157992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:00.173430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1153/2311] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:00.174659 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:00.185745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58ddb-de38-4334-8148-329dfcd62baf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:00.192014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fb510-b881-486a-841c-f93d3b843e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:00.192723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fb510-b881-486a-841c-f93d3b843e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:00.193009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fb510-b881-486a-841c-f93d3b843e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:00.193326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fb510-b881-486a-841c-f93d3b843e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:00.194072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fb510-b881-486a-841c-f93d3b843e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:00.195767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fb510-b881-486a-841c-f93d3b843e54 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:00.207738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1159/2312] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:00 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:21:00.212507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:00.223496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c10745-c189-42be-aef9-eb3e85a6d2bd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:00.228911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:00.229948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:00.230194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:00.230393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] PATH_INFO: `/v3/projects/105b8efe222f49bb88cdc3eee7c3d75e/users/4302801258614547b55efc95a1951c44/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:00.247852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105b8efe222f49bb88cdc3eee7c3d75e, user_id=4302801258614547b55efc95a1951c44, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:00.252649 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:00.269767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1154/2313] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:00 2022] PUT /identity/v3/projects/105b8efe222f49bb88cdc3eee7c3d75e/users/4302801258614547b55efc95a1951c44/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:00.275672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:00.276043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:00.276325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:00.292180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:00.299224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:00.301072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:00.368093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1160/2314] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:00.378460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:00.380403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:00.461222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b972e1b-fbc7-47f8-aa60-bbd7ea4f6d39 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:00.466694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c59f0-a5b4-467b-b370-2283c9fb6b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:00.467729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c59f0-a5b4-467b-b370-2283c9fb6b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:00.468220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c59f0-a5b4-467b-b370-2283c9fb6b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:00.468833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c59f0-a5b4-467b-b370-2283c9fb6b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:00.485892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c59f0-a5b4-467b-b370-2283c9fb6b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:00.488662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c59f0-a5b4-467b-b370-2283c9fb6b6a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:00.505917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1155/2315] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:01.260905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:01.260905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:01.275746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87936-23c5-41b9-a1b2-5825b761c302 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:01.280816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:01.282163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.282559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.282897 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] PATH_INFO: `/v3/users/72c50d10eeba4f11acde5a4b635c8574` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.284287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c50d10eeba4f11acde5a4b635c8574)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:01.286524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:01.349464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c50d10eeba4f11acde5a4b635c8574'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:01.365418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c50d10eeba4f11acde5a4b635c8574'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:01.366285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c50d10eeba4f11acde5a4b635c8574'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:01.396173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c50d10eeba4f11acde5a4b635c8574'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:01.396813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ac6dd896-7e2c-49c0-b532-d0ea23ad3ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c50d10eeba4f11acde5a4b635c8574'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:01.419869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1161/2316] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:01 2022] DELETE /identity/v3/users/72c50d10eeba4f11acde5a4b635c8574 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:01.426042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.426590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.426590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.458590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:01.460533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:01.467139 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.467876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.468185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.507622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] MFA Rules not processed for user `4302801258614547b55efc95a1951c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:01.508919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:01.603049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1156/2317] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:01.614073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:01.615766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:01.616883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1162/2318] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:01.620570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:01.622652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:01.644040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50645a-eecd-49b6-8cf9-f27635742985 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:01.650200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:01.651816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.652111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.652394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.653527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:01.657000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:01.665227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:01.671996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:01.701466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e425-9081-497e-a046-9d219cec89fc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:01.706867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:01.707045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.707393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.708426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.711015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1163/2319] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:01 2022] POST /identity/v3/projects => generated 374 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:21:01.714921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:01.726394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:01.728883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:01.760552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1157/2320] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:21:01.810779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262571-533f-4fed-b108-e3a4528ef299 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:01.818582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:01.819338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.819663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.819945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.820833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:01.823407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:01.869272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1164/2321] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:01 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:21:01.874054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:01.891138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460991-1690-4204-af0a-f7b121f42ab3 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:01.906224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:01.907536 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.908067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.908497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:01.909587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:01.914654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:01.945098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1158/2322] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:01 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:01.948429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:01.963750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524822-39e4-42be-ad92-a60f09941cfa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:01.975478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:01.976628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:01.977421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:01.977890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] PATH_INFO: `/v3/projects/34e0bc76c1b344eb9ecf9f62c1921306/users/3a9a85fe4ded41fab3ed1d8e85ca052c/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:02.006279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e0bc76c1b344eb9ecf9f62c1921306, user_id=3a9a85fe4ded41fab3ed1d8e85ca052c, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:02.017511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:02.053389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1165/2323] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:01 2022] PUT /identity/v3/projects/34e0bc76c1b344eb9ecf9f62c1921306/users/3a9a85fe4ded41fab3ed1d8e85ca052c/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:02.058179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:02.117953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1d263-177a-4920-91c4-a3c67a692742 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:02.339193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:02.340544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:02.341057 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:02.341665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:02.343682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:02.347519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:02.362659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1159/2324] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:02 2022] GET /identity/v3/roles => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:02.367295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:02.385543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51960a4-546c-460c-adbb-e6dedfa59a90 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:02.399750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:02.403134 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:02.403661 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:02.404104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] PATH_INFO: `/v3/projects/34e0bc76c1b344eb9ecf9f62c1921306/users/3a9a85fe4ded41fab3ed1d8e85ca052c/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:02.408372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e0bc76c1b344eb9ecf9f62c1921306, user_id=3a9a85fe4ded41fab3ed1d8e85ca052c, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:02.413787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:02.422692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:02.424995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:02.432190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1166/2325] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:02 2022] PUT /identity/v3/projects/34e0bc76c1b344eb9ecf9f62c1921306/users/3a9a85fe4ded41fab3ed1d8e85ca052c/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:02.446230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cbac-d7c2-43c9-9cf0-a8eed0321a2d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:02.556431 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:02.557492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:02.557964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:02.558483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] PATH_INFO: `/v3/projects/ba0637c1f98a48f2bbd96289bd0ab312` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:02.560003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0637c1f98a48f2bbd96289bd0ab312)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:02.562298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:02.619098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0637c1f98a48f2bbd96289bd0ab312', 'request_id': 'req-41ac60dd-c164-4006-8e81-2ac27159e35d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.628687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0637c1f98a48f2bbd96289bd0ab312', 'request_id': 'req-41ac60dd-c164-4006-8e81-2ac27159e35d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.640020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0637c1f98a48f2bbd96289bd0ab312', 'request_id': 'req-41ac60dd-c164-4006-8e81-2ac27159e35d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.643276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:02.661948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] The token cache is being invalidate because project ba0637c1f98a48f2bbd96289bd0ab312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:02.662259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.665581 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.668982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1160/2326] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:02 2022] DELETE /identity/v3/projects/ba0637c1f98a48f2bbd96289bd0ab312 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:02.673214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:02.675510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:02.696014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b09f8-6e74-40ed-977e-762b4dbc4961 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:02.764264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:02.765222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:02.765579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:02.765866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] PATH_INFO: `/v3/users/b00240975cf744d99f31f9abc172644e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:02.767132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00240975cf744d99f31f9abc172644e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:02.769350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:02.821618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:02.828205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00240975cf744d99f31f9abc172644e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.850239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00240975cf744d99f31f9abc172644e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.851073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00240975cf744d99f31f9abc172644e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.863996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00240975cf744d99f31f9abc172644e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.865250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-750562ab-aa78-4fc0-bff6-41059fa1b10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00240975cf744d99f31f9abc172644e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:02.883018 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1167/2327] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:02 2022] DELETE /identity/v3/users/b00240975cf744d99f31f9abc172644e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:03.334144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:03.364250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac60dd-c164-4006-8e81-2ac27159e35d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:03.505357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:03.506441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:03.506682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:03.507203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] PATH_INFO: `/v3/projects/ab0fcfb073904e2a8c7741060ea368c0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:03.509412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0fcfb073904e2a8c7741060ea368c0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:03.512780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:03.579009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0fcfb073904e2a8c7741060ea368c0', 'request_id': 'req-37a97f93-2b85-4403-af15-125b048e1e58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:03.592938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0fcfb073904e2a8c7741060ea368c0', 'request_id': 'req-37a97f93-2b85-4403-af15-125b048e1e58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:03.606549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0fcfb073904e2a8c7741060ea368c0', 'request_id': 'req-37a97f93-2b85-4403-af15-125b048e1e58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:03.625448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] The token cache is being invalidate because project ab0fcfb073904e2a8c7741060ea368c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:03.626004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:03.627585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-37a97f93-2b85-4403-af15-125b048e1e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:03.630973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1161/2328] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:03 2022] DELETE /identity/v3/projects/ab0fcfb073904e2a8c7741060ea368c0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:03.635866 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3df1d-9e94-41c2-9d69-fa3c4d18eff2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:03.636377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3df1d-9e94-41c2-9d69-fa3c4d18eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:03.636473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3df1d-9e94-41c2-9d69-fa3c4d18eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:03.677439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-58d3df1d-9e94-41c2-9d69-fa3c4d18eff2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:03.679378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-58d3df1d-9e94-41c2-9d69-fa3c4d18eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:03.859000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1168/2329] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:03.873856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6779-9dae-4399-a7aa-9810efe58735 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:03.874748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6779-9dae-4399-a7aa-9810efe58735 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:03.876430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6779-9dae-4399-a7aa-9810efe58735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:03.884525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:03.885289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:03.886058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:03.940402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:03.944925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:03.971398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-139d6779-9dae-4399-a7aa-9810efe58735 None None] MFA Rules not processed for user `3a9a85fe4ded41fab3ed1d8e85ca052c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:03.974809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-139d6779-9dae-4399-a7aa-9810efe58735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:03.984638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1169/2330] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:03.990955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.007476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea525b7a-2783-462c-b9ce-6629771bd057 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.016784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.018131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.018839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.019418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.020582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:21:04.021152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.024994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.070635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1170/2331] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:21:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:21:04.071927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.095482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f710-f23b-4d40-adaa-17647a78a4ad admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.108811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.111071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.111428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.112499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.120004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.123188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.179722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1171/2332] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:04 2022] POST /identity/v3/projects => generated 382 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:04.185684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.234543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1162/2333] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:04.243805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.244112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.244430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.274247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] MFA Rules not processed for user `4302801258614547b55efc95a1951c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:04.276051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:04.282086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:04.295347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096a31c-3e1d-45f6-ab04-0004a4cebdb3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.306019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.308043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.308543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.310047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.311347 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.314949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.343216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1172/2334] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:04 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:04.347702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.353696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1163/2335] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:04.359791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e81d10-5331-452e-bc75-9e2cea3bf644 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.365602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.367921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:04.371638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.377231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.377231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.377231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.377231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.377231 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.377755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:04.394903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1173/2336] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:04 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:21:04.399100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.412479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5db2-c337-44cb-885b-44974ee303f5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.419211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.420065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.420641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.420753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.421492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.423449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.443678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1174/2337] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:04 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:21:04.444968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.456142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa8b4-b76b-4527-a056-27ebdb6c9062 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.457141 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a91d3c-ab3b-4b59-b72a-853f4243d21c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.462820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.464169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.464315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.464656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.464914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.465011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] PATH_INFO: `/v3/projects/6fff8fea5d034b94b2b123fa4a25d4d0/users/aba1133049824a018b45acf79cdadd86/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.465229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.465670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.467835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:04.479282 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.480809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549cbdb-5185-4a1a-a018-f4edee3b6f7d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.486398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fff8fea5d034b94b2b123fa4a25d4d0, user_id=aba1133049824a018b45acf79cdadd86, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.490419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.491047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1164/2338] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:21:04.508020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1175/2339] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:04 2022] PUT /identity/v3/projects/6fff8fea5d034b94b2b123fa4a25d4d0/users/aba1133049824a018b45acf79cdadd86/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:04.519498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febd21-abae-4821-8abf-023ab715bced None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.519498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febd21-abae-4821-8abf-023ab715bced None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.519951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febd21-abae-4821-8abf-023ab715bced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.550257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-31febd21-abae-4821-8abf-023ab715bced None None] MFA Rules not processed for user `aba1133049824a018b45acf79cdadd86`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:04.551482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-31febd21-abae-4821-8abf-023ab715bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:04.625614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1165/2340] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:04.630520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.703858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc59fc-a595-4b44-bea1-d271e7f9fd95 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.709055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.710182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.710586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.710931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.711739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.713844 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.748496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1176/2341] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:04 2022] POST /identity/v3/projects => generated 384 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:04.753183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febd21-abae-4821-8abf-023ab715bced None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.768624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febd21-abae-4821-8abf-023ab715bced None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.814194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:04.843388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.844082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.844677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.845010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.845699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.847778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.873784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1166/2342] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:04 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:04.875044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.886417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3d95f-f343-48ee-9fc8-3b6ea093e4a2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.891252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.892011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.892366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.892714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.893719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.895732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.936284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1177/2343] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:04 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:21:04.938084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:04.949566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acafe-b3e5-445c-8de5-4f5895450342 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:04.955092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:04.956231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:04.956531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:04.956876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] PATH_INFO: `/v3/projects/cf8ac86afabe4befa39942034fe886a6/users/0cc8eb2c6df54a56be274c20d55c7a29/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:04.975724 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8ac86afabe4befa39942034fe886a6, user_id=0cc8eb2c6df54a56be274c20d55c7a29, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:04.978718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:04.998124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1167/2344] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:04 2022] PUT /identity/v3/projects/cf8ac86afabe4befa39942034fe886a6/users/0cc8eb2c6df54a56be274c20d55c7a29/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:04.999472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:05.018509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86025e-35f9-495f-bd42-70ff4e138fcd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:05.111964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe80bf-dd3d-4e49-a91d-a515b0c0418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:05.111964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe80bf-dd3d-4e49-a91d-a515b0c0418a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:05.111964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe80bf-dd3d-4e49-a91d-a515b0c0418a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:05.111964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe80bf-dd3d-4e49-a91d-a515b0c0418a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:05.112472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe80bf-dd3d-4e49-a91d-a515b0c0418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:05.114412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe80bf-dd3d-4e49-a91d-a515b0c0418a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:05.126243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1178/2345] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:04 2022] GET /identity/v3/roles => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:05.131168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:05.151503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864df1c-88c3-486a-ae87-f0a9b71708ec admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:05.164766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:05.166356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:05.173437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:05.174667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] PATH_INFO: `/v3/projects/cf8ac86afabe4befa39942034fe886a6/users/0cc8eb2c6df54a56be274c20d55c7a29/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:05.177400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8ac86afabe4befa39942034fe886a6, user_id=0cc8eb2c6df54a56be274c20d55c7a29, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:05.180120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:05.194296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1168/2346] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:05 2022] PUT /identity/v3/projects/cf8ac86afabe4befa39942034fe886a6/users/0cc8eb2c6df54a56be274c20d55c7a29/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:05.204887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:05.205312 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:05.205601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:05.242459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] MFA Rules not processed for user `0cc8eb2c6df54a56be274c20d55c7a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:05.243747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:05.264577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:05.334014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1179/2347] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:05.348798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:05.350699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:05.428661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1e83f-b24a-4442-83b8-a843d50afa74 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:05.433525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:05.434382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:05.434725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:05.435005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:05.451162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:05.453523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:05.475422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1169/2348] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:05.553171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:05.563372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8590df5-dd4c-4492-b457-20823eef9444 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:05.567065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7cac7-57f8-4339-a08a-67f2a0676472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:05.567724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cac7-57f8-4339-a08a-67f2a0676472 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:05.568011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cac7-57f8-4339-a08a-67f2a0676472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:05.568286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cac7-57f8-4339-a08a-67f2a0676472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:05.630059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7cac7-57f8-4339-a08a-67f2a0676472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:05.631524 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7cac7-57f8-4339-a08a-67f2a0676472 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:05.641146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1180/2349] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:05.920408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:05.991605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87921-c2c4-4905-8f78-f6903eab9104 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:05.996493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:05.997657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:05.997771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:05.997984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] PATH_INFO: `/v3/users/aba1133049824a018b45acf79cdadd86` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:05.999252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba1133049824a018b45acf79cdadd86)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:06.001477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:06.033672 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:06.053939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba1133049824a018b45acf79cdadd86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.054608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba1133049824a018b45acf79cdadd86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.055200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba1133049824a018b45acf79cdadd86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.067818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba1133049824a018b45acf79cdadd86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.077444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba1133049824a018b45acf79cdadd86'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.092369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1170/2350] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:05 2022] DELETE /identity/v3/users/aba1133049824a018b45acf79cdadd86 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:06.097258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.097995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.097995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.120198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:06.121451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:06.152402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:06.154911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:06.218021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1181/2351] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:06.231906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:06.234091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:06.262959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0724ed-e4c1-499a-bc8a-5a2bbd01f745 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:06.270499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:06.271818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.272177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.272524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] PATH_INFO: `/v3/users/ff06e7822ca44cd2b66978cf91ebcc2d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.274492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff06e7822ca44cd2b66978cf91ebcc2d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:06.277033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:06.320251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe929-1c0d-4836-a6f4-798071223f17 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:06.324502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d60e-455a-42dd-a738-a6b61d7b0983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:06.325200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d60e-455a-42dd-a738-a6b61d7b0983 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.325499 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d60e-455a-42dd-a738-a6b61d7b0983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.325751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d60e-455a-42dd-a738-a6b61d7b0983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.337381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d60e-455a-42dd-a738-a6b61d7b0983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:06.338938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d60e-455a-42dd-a738-a6b61d7b0983 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:06.343384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:06.350233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff06e7822ca44cd2b66978cf91ebcc2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.350604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1182/2352] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:06.353937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff06e7822ca44cd2b66978cf91ebcc2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.354565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff06e7822ca44cd2b66978cf91ebcc2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.367936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff06e7822ca44cd2b66978cf91ebcc2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.378939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff06e7822ca44cd2b66978cf91ebcc2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.398908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1171/2353] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:06 2022] DELETE /identity/v3/users/ff06e7822ca44cd2b66978cf91ebcc2d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:06.403733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.403963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.404244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.425608 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:06.426747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:06.501695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1183/2354] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:06.512683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:06.518234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:06.560274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:06.609988 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf46a-bfdf-4c1b-8e89-c1d7f974e37b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:06.615698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:06.616529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.616879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.617247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.628906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:06.630568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:06.643158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1172/2355] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:06.708515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:06.710518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:06.742448 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7489088-2f5e-456b-961e-2a8b87853028 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:06.756564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:06.757181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.757471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.757748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] PATH_INFO: `/v3/projects/6fff8fea5d034b94b2b123fa4a25d4d0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.759106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fff8fea5d034b94b2b123fa4a25d4d0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:06.762103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:06.843869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fff8fea5d034b94b2b123fa4a25d4d0', 'request_id': 'req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.868481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fff8fea5d034b94b2b123fa4a25d4d0', 'request_id': 'req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.881457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fff8fea5d034b94b2b123fa4a25d4d0', 'request_id': 'req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.895501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] The token cache is being invalidate because project 6fff8fea5d034b94b2b123fa4a25d4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:06.895686 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.896357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:06.898123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1184/2356] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:06 2022] DELETE /identity/v3/projects/6fff8fea5d034b94b2b123fa4a25d4d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:06.902376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:06.912907 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dfa9a-e70d-4ce1-b548-dc65c44747b4 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:06.972893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:06.974092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:06.974177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:06.974382 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] PATH_INFO: `/v3/users/0cc8eb2c6df54a56be274c20d55c7a29` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:06.975768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc8eb2c6df54a56be274c20d55c7a29)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:06.977805 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:07.030577 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc8eb2c6df54a56be274c20d55c7a29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.032710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc8eb2c6df54a56be274c20d55c7a29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.033439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc8eb2c6df54a56be274c20d55c7a29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.054992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc8eb2c6df54a56be274c20d55c7a29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.066731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aae43de0-dfce-4bf3-a46b-bdddc185ceb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc8eb2c6df54a56be274c20d55c7a29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.087176 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1173/2357] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:06 2022] DELETE /identity/v3/users/0cc8eb2c6df54a56be274c20d55c7a29 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:07.219693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:07.222500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:07.270573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4985d-a0e1-45e9-82d9-aa1955c6fa6d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:07.425162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:07.425162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:07.425162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:07.425162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] PATH_INFO: `/v3/projects/52c10f7d5d7c41b88802a28065c3ce6e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:07.428037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c10f7d5d7c41b88802a28065c3ce6e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:07.430328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:07.529066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:07.555042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c10f7d5d7c41b88802a28065c3ce6e', 'request_id': 'req-4314eaba-a39e-4c36-9a39-0b4b648ada72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.565378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c10f7d5d7c41b88802a28065c3ce6e', 'request_id': 'req-4314eaba-a39e-4c36-9a39-0b4b648ada72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.574280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c10f7d5d7c41b88802a28065c3ce6e', 'request_id': 'req-4314eaba-a39e-4c36-9a39-0b4b648ada72'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.609003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] The token cache is being invalidate because project 52c10f7d5d7c41b88802a28065c3ce6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:07.609745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.611998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4314eaba-a39e-4c36-9a39-0b4b648ada72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:07.622757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1185/2358] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:07 2022] DELETE /identity/v3/projects/52c10f7d5d7c41b88802a28065c3ce6e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:07.623885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:07.624186 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:07.624464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:07.658022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:07.659616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:07.716014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:07.760506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1174/2359] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:07.762749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:07.763155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:07.763649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:07.800579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:07.802376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:07.814998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1186/2360] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:07.820667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:07.834890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c59b-fe88-4696-974d-c1f0341a2f5f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:07.868606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:07.869423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:07.869713 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:07.870020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:07.870807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:21:07.871154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:07.874071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:07.911095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1175/2361] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:21:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:21:07.915919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:07.941186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13579ea5-ec99-4534-9ff5-c9de953e4c3d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:07.946473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:07.947212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:07.947501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:07.947778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:07.948699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:07.951531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.005247 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1187/2362] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:07 2022] POST /identity/v3/projects => generated 384 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:08.009503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.022967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af279-7ebf-465a-97d3-114729a395a3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.111812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.112665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.113022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.113397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.114357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.116701 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.149379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1176/2363] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:08 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:08.150799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.166823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e9df-fcf2-4f86-8602-bf3ce79e67b3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.174444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.174444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.175024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.176174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.176942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.178642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.195640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1188/2364] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:08 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:08.197643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.212820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1f46-b6cb-469a-a4aa-a91087ff6689 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.217930 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa15c-0d38-49b0-8518-3f1acb1b8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.219296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa15c-0d38-49b0-8518-3f1acb1b8fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.219590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa15c-0d38-49b0-8518-3f1acb1b8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.219877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa15c-0d38-49b0-8518-3f1acb1b8fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.220629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa15c-0d38-49b0-8518-3f1acb1b8fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.222307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa15c-0d38-49b0-8518-3f1acb1b8fb6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.236053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1177/2365] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:08 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:08.240888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.252397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c1eb-2b3b-4263-ad3e-38a354f97d7d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.258061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.259050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.259446 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.259824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] PATH_INFO: `/v3/projects/b0a2fa78de7f441e947dccd498f9877a/users/79d9b956f7f14598ae34c492443533f0/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.295779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a2fa78de7f441e947dccd498f9877a, user_id=79d9b956f7f14598ae34c492443533f0, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.298792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.327326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1189/2366] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:08 2022] PUT /identity/v3/projects/b0a2fa78de7f441e947dccd498f9877a/users/79d9b956f7f14598ae34c492443533f0/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:08.337552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.339900 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:08.346429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.346900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.347330 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.447014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:08.450939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:08.484905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809390c8-b61b-4070-b586-e6fdefc98804 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.504577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.505625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.506587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.506942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] PATH_INFO: `/v3/projects/cf8ac86afabe4befa39942034fe886a6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.512426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8ac86afabe4befa39942034fe886a6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.514544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.567032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1178/2367] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:08.581819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.583682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:08.622186 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8ac86afabe4befa39942034fe886a6', 'request_id': 'req-71e1ecb0-f098-432c-84f9-6f341d45b4a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:08.624353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:08.634395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8ac86afabe4befa39942034fe886a6', 'request_id': 'req-71e1ecb0-f098-432c-84f9-6f341d45b4a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:08.650142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8ac86afabe4befa39942034fe886a6', 'request_id': 'req-71e1ecb0-f098-432c-84f9-6f341d45b4a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:08.677816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] The token cache is being invalidate because project cf8ac86afabe4befa39942034fe886a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:08.678202 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:08.681217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71e1ecb0-f098-432c-84f9-6f341d45b4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:08.683107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab279-ee3e-49b9-938b-156a28df51f7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.689471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1190/2368] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:08 2022] DELETE /identity/v3/projects/cf8ac86afabe4befa39942034fe886a6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:08.691948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742e087-f1a9-450d-8e20-f4ffc68eb1cd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.692242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742e087-f1a9-450d-8e20-f4ffc68eb1cd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.692525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742e087-f1a9-450d-8e20-f4ffc68eb1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.697736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:08.728871 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a742e087-f1a9-450d-8e20-f4ffc68eb1cd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:08.730161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a742e087-f1a9-450d-8e20-f4ffc68eb1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:08.769437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.770521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.770963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.772268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.773362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:08.819970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1191/2369] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:08.828068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.828361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.828648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.850185 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:08.851473 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:08.853470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.855138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.861599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1192/2370] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:08.865789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.868371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1179/2371] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:08.875922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5879d5-07eb-4bae-b6b3-2e2d8997b5bd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.882578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.883339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.883628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.883908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.884660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:21:08.884973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.887113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:08.902044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1193/2372] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:21:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:21:08.907286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:08.921144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1068ea-bddc-421a-a14d-71e4f084ff3d service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:08.929901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:08.930629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:08.930911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:08.931185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:08.932267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:08.934255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.001161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1180/2373] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:08 2022] POST /identity/v3/projects => generated 376 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:09.005317 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.016263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970794f5-932d-44c8-91e9-094207246f22 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.150893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.151395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.152190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.152578 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.153465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.156403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.194409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1194/2374] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:09 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:09.195717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.209789 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498647b-5445-472c-81d1-67a64271a7ae admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.223746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.224918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.228292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.228292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.229130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.232879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.272726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1181/2375] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:09 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:21:09.274132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.290472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6101b-68ca-406a-a981-1c278b1dba82 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.304817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a164a-64e0-4960-9654-1d819e9c678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.305710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a164a-64e0-4960-9654-1d819e9c678a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.306040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a164a-64e0-4960-9654-1d819e9c678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.306358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a164a-64e0-4960-9654-1d819e9c678a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.307181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a164a-64e0-4960-9654-1d819e9c678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.308921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a164a-64e0-4960-9654-1d819e9c678a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.335623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1195/2376] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:09 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:09.341590 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.368154 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d6bc-d16f-42a6-8699-02f7d607d4c1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.391261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.396905 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.397899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.398654 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] PATH_INFO: `/v3/projects/0a759b2162194e0098de2cd68ed881d6/users/5c5779d2f10f48d590fc0b1ace15f0c0/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.439817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a759b2162194e0098de2cd68ed881d6, user_id=5c5779d2f10f48d590fc0b1ace15f0c0, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.443717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.480436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1182/2377] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:09 2022] PUT /identity/v3/projects/0a759b2162194e0098de2cd68ed881d6/users/5c5779d2f10f48d590fc0b1ace15f0c0/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:09.492143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.492554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.492965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.527793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] MFA Rules not processed for user `5c5779d2f10f48d590fc0b1ace15f0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:09.529911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:09.575324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:09.647906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1196/2378] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:09.650838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.738503 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8366b5-7d1d-41da-99b6-e8dedd5a22ac admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.744517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.745327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.745629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.745913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.746630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.748668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.756124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:09.791452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1183/2379] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:09 2022] POST /identity/v3/projects => generated 378 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:09.795444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.808243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c222-0f48-49d2-860a-af247f4d58ab None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.894792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.895824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.896398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.896783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.897674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.899779 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:09.930345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1197/2380] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:09 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:09.934855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:09.951990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94d7d-c25c-4680-ad4c-37217db043b2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:09.960361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:09.962554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:09.962861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:09.963298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:09.964073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:09.978803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.014180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1184/2381] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:09 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:10.015825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.031392 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c213ea-43fe-4ada-84d7-af0e87a49fc4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:10.037847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68f09-3741-4347-b84d-213c58ee9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:10.038598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68f09-3741-4347-b84d-213c58ee9cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.038884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68f09-3741-4347-b84d-213c58ee9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.039163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68f09-3741-4347-b84d-213c58ee9cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.039930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68f09-3741-4347-b84d-213c58ee9cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:10.041737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68f09-3741-4347-b84d-213c58ee9cc3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.061685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1198/2382] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:10 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:10.063531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.077083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebc49f-c75d-4a4b-9ba4-fd54b940809a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:10.084854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:10.086119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.086605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.087241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] PATH_INFO: `/v3/projects/643ec112da024310a139945aa9e6ccae/users/689bfb6124274aae966a27ce1119ff73/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.108768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=643ec112da024310a139945aa9e6ccae, user_id=689bfb6124274aae966a27ce1119ff73, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:10.112472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.143161 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1185/2383] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:10 2022] PUT /identity/v3/projects/643ec112da024310a139945aa9e6ccae/users/689bfb6124274aae966a27ce1119ff73/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:10.232532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.232828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.233108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.279674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] MFA Rules not processed for user `689bfb6124274aae966a27ce1119ff73`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:10.282013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:10.445986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.447193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1199/2384] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:10.535684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d953fb-d04b-4c18-a42e-13ff7d4d7eda admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:10.548094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:10.548855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.549142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.549444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.550202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:10.552138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.626116 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.634720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1186/2385] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:10 2022] POST /identity/v3/projects => generated 376 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:10.637622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888464a-7df5-498d-8f74-8240a951dc52 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:10.689537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:10.738154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:10.738994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.739384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.739745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.740588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:10.743230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.795137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1200/2386] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:10 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:10.797068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.809045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab976d8-7acc-490b-ba1d-b9017be6aebd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:10.815469 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:10.815622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.815832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.816273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.817064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:10.818824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.832820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1187/2387] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:10 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:10.837707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.851590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e406-b373-4aaf-8341-2865474a880b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:10.857854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:10.859252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:10.860029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:10.860480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] PATH_INFO: `/v3/projects/acbd5bb17fb445198d95bc219a0fb59f/users/18f7c97b9dc347fd9db0cc33f48db94a/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:10.879598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbd5bb17fb445198d95bc219a0fb59f, user_id=18f7c97b9dc347fd9db0cc33f48db94a, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:10.885907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:10.914710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1201/2388] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:10 2022] PUT /identity/v3/projects/acbd5bb17fb445198d95bc219a0fb59f/users/18f7c97b9dc347fd9db0cc33f48db94a/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:10.918809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:10.932348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85694-08f6-4515-acf8-fcd3f4fd0b1d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:11.039123 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947629f7-75bc-4755-bd96-f404b2d06578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:11.040497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947629f7-75bc-4755-bd96-f404b2d06578 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:11.040785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947629f7-75bc-4755-bd96-f404b2d06578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:11.041063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947629f7-75bc-4755-bd96-f404b2d06578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:11.041855 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947629f7-75bc-4755-bd96-f404b2d06578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:11.043741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947629f7-75bc-4755-bd96-f404b2d06578 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:11.061364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1188/2389] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:10 2022] GET /identity/v3/roles => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:21:11.061677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:11.075416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af9143-e046-4af6-a792-04f7ef6b7652 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:11.087425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:11.088485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:11.088870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:11.089278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] PATH_INFO: `/v3/projects/acbd5bb17fb445198d95bc219a0fb59f/users/18f7c97b9dc347fd9db0cc33f48db94a/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:11.093869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbd5bb17fb445198d95bc219a0fb59f, user_id=18f7c97b9dc347fd9db0cc33f48db94a, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:11.097050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:11.110890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1202/2390] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:11 2022] PUT /identity/v3/projects/acbd5bb17fb445198d95bc219a0fb59f/users/18f7c97b9dc347fd9db0cc33f48db94a/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:11.122636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:11.123111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:11.123512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:11.169484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] MFA Rules not processed for user `18f7c97b9dc347fd9db0cc33f48db94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:11.172147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:11.189415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:11.347835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1189/2391] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:11.363085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:11.365528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:11.568180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d844a-2409-49b7-b7cb-32072074c2f9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:11.572562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:11.573310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:11.573588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:11.573863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:11.679314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:11.681386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:11.697592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1203/2392] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:13.421311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:13.423135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:13.435792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87cef3-ec47-4a97-a21c-1ca8a5499cd8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:13.440699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207b124-f5e7-4e5b-bf44-27c2261552a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:13.441406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207b124-f5e7-4e5b-bf44-27c2261552a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:13.441687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207b124-f5e7-4e5b-bf44-27c2261552a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:13.441962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207b124-f5e7-4e5b-bf44-27c2261552a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:13.528665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207b124-f5e7-4e5b-bf44-27c2261552a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:13.530307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207b124-f5e7-4e5b-bf44-27c2261552a8 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:13.541927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1190/2393] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:14.469237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:14.480009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583927-98c3-493b-aa1e-41f615e5402d service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:14.484119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:14.484812 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:14.485093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:14.485434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:14.496829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:14.498388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:14.510447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1204/2394] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:15.054923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.055540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.055540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.109921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] MFA Rules not processed for user `79d9b956f7f14598ae34c492443533f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:15.127575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:15.261886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1191/2395] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:15.266434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:15.268052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:15.314842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:15.360287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e3e45-f81d-4c34-9191-9ff1f4a17de7 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:15.367255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:15.367865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.368147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.368425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.369178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:15.371191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:15.405307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1205/2396] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:15 2022] POST /identity/v3/projects => generated 384 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:15.410089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:15.425687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa45a6-d506-4549-9630-d594c6cd5f8e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:15.474311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:15.513616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:15.518493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.518784 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.519068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.519892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:15.522353 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:15.562372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1192/2397] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:15 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:15.563385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:15.575943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e293-8b5d-4394-92c7-211bc1815522 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:15.582058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:15.582922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.583340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.583839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.585072 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:15.587141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:15.604027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1206/2398] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:15 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:15.605337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:15.617031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2a4d-dbf4-4bc4-a19f-62f443b94ff5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:15.622755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:15.623714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.623999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.624549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] PATH_INFO: `/v3/projects/dc3fd01cad76444ebbdbd3d7688a9c8f/users/3183b56a309547ee9299752f386b4416/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.642139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3fd01cad76444ebbdbd3d7688a9c8f, user_id=3183b56a309547ee9299752f386b4416, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:15.644850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:15.661879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1193/2399] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:15 2022] PUT /identity/v3/projects/dc3fd01cad76444ebbdbd3d7688a9c8f/users/3183b56a309547ee9299752f386b4416/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:15.666295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:15.678029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da295e97-a829-4eda-930a-77f25366ca1a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:15.772464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:15.773397 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.773925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.774367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.775234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:15.777014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:15.794085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:15.801940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1207/2400] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:15 2022] GET /identity/v3/roles => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:15.806619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98144b-9483-44b3-8bd4-4bd851626c07 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:15.813797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0b418-69f4-4918-9407-4f97c111c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:15.814728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b418-69f4-4918-9407-4f97c111c4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:15.815008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b418-69f4-4918-9407-4f97c111c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:15.815280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b418-69f4-4918-9407-4f97c111c4d5 admin admin] PATH_INFO: `/v3/projects/dc3fd01cad76444ebbdbd3d7688a9c8f/users/3183b56a309547ee9299752f386b4416/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:15.817779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0b418-69f4-4918-9407-4f97c111c4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3fd01cad76444ebbdbd3d7688a9c8f, user_id=3183b56a309547ee9299752f386b4416, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:15.821068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0b418-69f4-4918-9407-4f97c111c4d5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:15.839596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1194/2401] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:15 2022] PUT /identity/v3/projects/dc3fd01cad76444ebbdbd3d7688a9c8f/users/3183b56a309547ee9299752f386b4416/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:19.054190 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:19.067288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b780-85c0-4369-82d4-e74e471e0593 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:19.265434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:19.268013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:19.269960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:19.271833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] PATH_INFO: `/v3/users/5c5779d2f10f48d590fc0b1ace15f0c0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:19.276476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5779d2f10f48d590fc0b1ace15f0c0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:19.285652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:19.444088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:19.471438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5779d2f10f48d590fc0b1ace15f0c0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:19.559564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5779d2f10f48d590fc0b1ace15f0c0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:19.565627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5779d2f10f48d590fc0b1ace15f0c0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:19.585913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5779d2f10f48d590fc0b1ace15f0c0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:19.598938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5779d2f10f48d590fc0b1ace15f0c0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:19.645234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1208/2402] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:19 2022] DELETE /identity/v3/users/5c5779d2f10f48d590fc0b1ace15f0c0 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:19.649995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:19.650658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:19.650658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:19.697482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:19.699101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:19.815320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1195/2403] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:19.831942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:19.833432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:19.939107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5167-aabb-4147-9e4f-a4566fe1a291 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:19.943706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:19.944755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:19.945364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:19.945850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:19.958005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:19.960443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:20.004620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1209/2404] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:21.004772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:21.006374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:21.038675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a967-f892-4b53-95b0-7f9f43b5e418 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:21.052716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:21.053720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:21.054017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:21.054274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] PATH_INFO: `/v3/projects/0a759b2162194e0098de2cd68ed881d6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:21.055632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a759b2162194e0098de2cd68ed881d6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:21.062107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:21.195694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a759b2162194e0098de2cd68ed881d6', 'request_id': 'req-423ff1d2-a827-4ef6-8fa2-c57d4857b719'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.209863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a759b2162194e0098de2cd68ed881d6', 'request_id': 'req-423ff1d2-a827-4ef6-8fa2-c57d4857b719'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.220775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a759b2162194e0098de2cd68ed881d6', 'request_id': 'req-423ff1d2-a827-4ef6-8fa2-c57d4857b719'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.241522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] The token cache is being invalidate because project 0a759b2162194e0098de2cd68ed881d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:21.241522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.242094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.248613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1196/2405] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:21 2022] DELETE /identity/v3/projects/0a759b2162194e0098de2cd68ed881d6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:21.250171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:21.274639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ae09a-84b7-47ef-b2ae-2b4c2c54eae7 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:21.466366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:21.467520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:21.468036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:21.468423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] PATH_INFO: `/v3/users/689bfb6124274aae966a27ce1119ff73` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:21.478500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=689bfb6124274aae966a27ce1119ff73)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:21.481158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:21.586271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689bfb6124274aae966a27ce1119ff73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.618855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:21.623624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689bfb6124274aae966a27ce1119ff73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.627669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689bfb6124274aae966a27ce1119ff73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.646268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689bfb6124274aae966a27ce1119ff73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.647157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689bfb6124274aae966a27ce1119ff73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:21.686634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1210/2406] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:21 2022] DELETE /identity/v3/users/689bfb6124274aae966a27ce1119ff73 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:22.393520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:22.402019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:22.441953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff1d2-a827-4ef6-8fa2-c57d4857b719 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:22.471378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:22.596020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:22.597473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:22.598069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:22.598604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] PATH_INFO: `/v3/projects/643ec112da024310a139945aa9e6ccae` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:22.600244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=643ec112da024310a139945aa9e6ccae)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:22.604690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:22.712177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643ec112da024310a139945aa9e6ccae', 'request_id': 'req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:22.727566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643ec112da024310a139945aa9e6ccae', 'request_id': 'req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:22.739138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643ec112da024310a139945aa9e6ccae', 'request_id': 'req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:22.761829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] The token cache is being invalidate because project 643ec112da024310a139945aa9e6ccae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:22.762884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:22.764118 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:22.767054 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1197/2407] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:22 2022] DELETE /identity/v3/projects/643ec112da024310a139945aa9e6ccae => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:22.772463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:22.774407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:22.791563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3ca71-d033-4f5f-a94b-633b818c4ecd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:22.953892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:22.955386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:22.955950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:22.957285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] PATH_INFO: `/v3/users/18f7c97b9dc347fd9db0cc33f48db94a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:22.959509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f7c97b9dc347fd9db0cc33f48db94a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:22.962023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:23.043589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f7c97b9dc347fd9db0cc33f48db94a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:23.081476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f7c97b9dc347fd9db0cc33f48db94a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:23.085395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f7c97b9dc347fd9db0cc33f48db94a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:23.097084 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f7c97b9dc347fd9db0cc33f48db94a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:23.098212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f7c97b9dc347fd9db0cc33f48db94a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:23.125164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1211/2408] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:22 2022] DELETE /identity/v3/users/18f7c97b9dc347fd9db0cc33f48db94a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:23.723389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:23.725545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:23.750205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:23.751692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:23.835712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7ca4c-66a3-48ba-b7c4-a6409414f4fe admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:23.948115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:23.949507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:23.949968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:23.950393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:23.955778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:23.962510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a3a5-0a0b-43e3-aad8-3b3d760081ae admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:23.972842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:23.974127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:23.977055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:23.977562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:23.977917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] PATH_INFO: `/v3/projects/acbd5bb17fb445198d95bc219a0fb59f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:23.979586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbd5bb17fb445198d95bc219a0fb59f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:23.984914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.000014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:24.115307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.117012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b06e0-f756-45b1-8bb7-7a8c949d469d service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.162668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1198/2409] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:24.193293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbd5bb17fb445198d95bc219a0fb59f', 'request_id': 'req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:24.207845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbd5bb17fb445198d95bc219a0fb59f', 'request_id': 'req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:24.221152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbd5bb17fb445198d95bc219a0fb59f', 'request_id': 'req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:24.269346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] The token cache is being invalidate because project acbd5bb17fb445198d95bc219a0fb59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:24.271020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:24.271798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2df4984b-2ea4-461a-984d-8d0f3a7bc5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:24.276120 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1212/2410] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:23 2022] DELETE /identity/v3/projects/acbd5bb17fb445198d95bc219a0fb59f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:24.282370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.282862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.283273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.336586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:24.337956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:24.438666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1199/2411] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:24.448301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.448538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.448764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.470948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:24.472213 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:24.501104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1213/2412] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:24.506227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:24.525498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1e32-8542-4d75-bff0-1ea3bdf327b2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:24.532239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:24.532908 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.533963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.533963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.534288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:21:24.534772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.536535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.569485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1200/2413] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:21:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:21:24.573987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:24.591332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a325c2-dabf-4405-a228-4a6a3a7f7756 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:24.598802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:24.599559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.599879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.600154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.600889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.603296 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.658554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:24.658800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1214/2414] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:24 2022] POST /identity/v3/projects => generated 374 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:21:24.673927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45ce68-e497-4cba-8f34-672162ccb2d1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:24.760816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:24.761680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.761906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.762180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.763096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.765343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.801873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1201/2415] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:24 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:24.803140 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:24.824565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e2417-b556-427f-a460-5c06e8efc56a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:24.832426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:24.833316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.833610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.835748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.839873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.843987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.860931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1215/2416] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:24 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:24.865517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:24.888974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661243a-b90d-4f09-80e3-0f4e595aab7d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:24.896583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc354983-e25a-4c70-add7-9fbf7660ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:24.896837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354983-e25a-4c70-add7-9fbf7660ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.897170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354983-e25a-4c70-add7-9fbf7660ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.897714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc354983-e25a-4c70-add7-9fbf7660ccf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.898509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354983-e25a-4c70-add7-9fbf7660ccf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.900191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc354983-e25a-4c70-add7-9fbf7660ccf9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.917325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1202/2417] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:24 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:24.918652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:24.930009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9865c-c340-4fa4-bf13-2ad3e79d4b3f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:24.935198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:24.936463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:24.936758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:24.937031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] PATH_INFO: `/v3/projects/bf0f72fa0b944ddbb4ae46d2db253ae0/users/75ef63dcb6514645aa1d8328c018ffcd/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:24.957848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0f72fa0b944ddbb4ae46d2db253ae0, user_id=75ef63dcb6514645aa1d8328c018ffcd, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:24.962973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:24.996257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1216/2418] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:24 2022] PUT /identity/v3/projects/bf0f72fa0b944ddbb4ae46d2db253ae0/users/75ef63dcb6514645aa1d8328c018ffcd/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:25.008598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca96e6-66e7-43de-87ed-4c694667bb93 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:25.008895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca96e6-66e7-43de-87ed-4c694667bb93 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:25.009213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca96e6-66e7-43de-87ed-4c694667bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:25.039460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:25.052474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-02ca96e6-66e7-43de-87ed-4c694667bb93 None None] MFA Rules not processed for user `75ef63dcb6514645aa1d8328c018ffcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:25.052474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-02ca96e6-66e7-43de-87ed-4c694667bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:25.187405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1203/2419] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:25.208262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:25.212479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:25.330147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:25.330397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:25.330729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:25.360745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7e342-a648-4372-9c56-38569f271bfe admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:25.373785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:25.374656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:25.375123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:25.375500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:25.399620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:25.401449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:25.405728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] MFA Rules not processed for user `3183b56a309547ee9299752f386b4416`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:25.410461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:25.417362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1217/2420] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:25.487416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:25.579796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:25.655526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1204/2421] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:25.670783 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:25.675003 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:25.708061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210880ff-72e0-4b08-ac56-83f042b8275b service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:25.724067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:25.724858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:25.725166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:25.725914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] PATH_INFO: `/v3/users/75ef63dcb6514645aa1d8328c018ffcd` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:25.729826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ef63dcb6514645aa1d8328c018ffcd)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:25.732039 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:25.833483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9fa98-a93a-4f8b-bc7a-bc36df7589ca None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:25.840204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:25.842090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:25.842383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:25.842762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:25.845710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:25.859867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ef63dcb6514645aa1d8328c018ffcd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:25.887799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ef63dcb6514645aa1d8328c018ffcd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:25.894280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ef63dcb6514645aa1d8328c018ffcd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:25.908698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ef63dcb6514645aa1d8328c018ffcd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:25.909517 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:25.909831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-73ad96df-6056-4b94-b65f-eb44e8deb32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ef63dcb6514645aa1d8328c018ffcd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:25.937377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:25.939037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:25.942492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1218/2422] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:25 2022] DELETE /identity/v3/users/75ef63dcb6514645aa1d8328c018ffcd => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:25.944832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5700973-10d8-445d-80a8-270b68223dbc None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:25.945382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5700973-10d8-445d-80a8-270b68223dbc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:25.945724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5700973-10d8-445d-80a8-270b68223dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:25.953584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1205/2423] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:25.973994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a5700973-10d8-445d-80a8-270b68223dbc None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:25.976034 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a5700973-10d8-445d-80a8-270b68223dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:26.083442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1219/2424] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:26.096133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:26.098112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:26.163059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:26.163059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:26.163059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:26.173727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f092d-4cde-44fe-9621-b41c93054d0f service glance] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:26.194825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:26.198093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:26.244844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:26.246125 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:26.246616 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:26.247143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:26.259808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:26.261345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:26.273613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1206/2425] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:26.290199 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:26.302634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1220/2426] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:21:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:26.356901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:26.358959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:26.480785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6e59a-6a33-43a3-ac54-bd23dc58524b service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:26.487924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559187d2-30bf-49ce-a4dc-71e6ca794580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:26.489001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559187d2-30bf-49ce-a4dc-71e6ca794580 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:26.489405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559187d2-30bf-49ce-a4dc-71e6ca794580 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:26.489767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559187d2-30bf-49ce-a4dc-71e6ca794580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:26.501069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559187d2-30bf-49ce-a4dc-71e6ca794580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:26.502115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559187d2-30bf-49ce-a4dc-71e6ca794580 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:26.513601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1207/2427] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:21:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:21:26.679142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:26.680878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:26.714266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc74e-d476-49ee-b02a-5cb76b97a2ea None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:26.724998 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:26.725968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:26.726308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:26.726533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] PATH_INFO: `/v3/projects/bf0f72fa0b944ddbb4ae46d2db253ae0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:26.729350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0f72fa0b944ddbb4ae46d2db253ae0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:26.731564 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:26.871280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0f72fa0b944ddbb4ae46d2db253ae0', 'request_id': 'req-28433893-1c5f-4373-a867-455230097a0a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:26.888879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0f72fa0b944ddbb4ae46d2db253ae0', 'request_id': 'req-28433893-1c5f-4373-a867-455230097a0a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:26.903130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0f72fa0b944ddbb4ae46d2db253ae0', 'request_id': 'req-28433893-1c5f-4373-a867-455230097a0a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:26.939829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] The token cache is being invalidate because project bf0f72fa0b944ddbb4ae46d2db253ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:26.940026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:26.943306 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-28433893-1c5f-4373-a867-455230097a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:26.948258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1221/2428] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:26 2022] DELETE /identity/v3/projects/bf0f72fa0b944ddbb4ae46d2db253ae0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:26.955329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:26.956578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:26.957038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.012380 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:27.018949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:27.118796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:27.215487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1208/2429] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:27.224091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:27.224752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:27.225037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.250452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:27.253374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:27.266803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1222/2430] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:21:27.271500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:27.291119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10f36-4da6-4eba-becd-1018e0b40ec7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:27.321790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:27.322520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:27.322813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:27.323097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.323898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:21:27.332296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:27.334319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:27.383406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1209/2431] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:21:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:21:27.385917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:27.402436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01827-a3ef-4abd-b641-d2444938c0a5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:27.413592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:27.414503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:27.418574 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:27.419037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.420281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:27.422471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:27.494821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1223/2432] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:27 2022] POST /identity/v3/projects => generated 376 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:27.495575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:27.514452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0b38-001b-46f7-a526-88cc2b6f092f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:27.725900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:27.726633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:27.726916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:27.727197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.728363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:27.734327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:27.799472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1210/2433] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:27 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:21:27.805012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:27.823506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf12d4-c6a6-46f4-9ab5-f70a609c34a5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:27.842440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:27.843496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:27.843781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:27.844137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.848485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:27.856478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:27.893161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1224/2434] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:27 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:27.894292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:27.916081 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395110-c5fa-4824-91de-4aa62d117fa9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:27.943532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3e692-4798-4c3b-9cbf-eea5669da6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:27.944249 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3e692-4798-4c3b-9cbf-eea5669da6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:27.944535 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3e692-4798-4c3b-9cbf-eea5669da6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:27.944811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3e692-4798-4c3b-9cbf-eea5669da6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:27.945665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3e692-4798-4c3b-9cbf-eea5669da6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:27.947339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3e692-4798-4c3b-9cbf-eea5669da6f8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:27.980484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1211/2435] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:27 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:27.984938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:28.002718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbba79-67ad-49c0-84ae-3b3ecc8bced2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:28.008773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:28.010308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:28.011704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:28.012242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] PATH_INFO: `/v3/projects/accf2f018e1849839ac934f81af2fe5d/users/5597f5ffc26041449aeb5750c8845aaf/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:28.044305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accf2f018e1849839ac934f81af2fe5d, user_id=5597f5ffc26041449aeb5750c8845aaf, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:28.047982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:28.087064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1225/2436] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:27 2022] PUT /identity/v3/projects/accf2f018e1849839ac934f81af2fe5d/users/5597f5ffc26041449aeb5750c8845aaf/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:28.111155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67502-f6d6-497f-ab01-0191a6604e97 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:28.111434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67502-f6d6-497f-ab01-0191a6604e97 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:28.111750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67502-f6d6-497f-ab01-0191a6604e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:28.178624 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-abb67502-f6d6-497f-ab01-0191a6604e97 None None] MFA Rules not processed for user `5597f5ffc26041449aeb5750c8845aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:28.180146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-abb67502-f6d6-497f-ab01-0191a6604e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:28.277653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1212/2437] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:28.293355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:28.296000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:28.371192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705fd1-a051-4f21-8b72-81c62893cec0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:28.405603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b425ed9-7b80-4c40-8e62-f3e728c6a310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:28.405603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b425ed9-7b80-4c40-8e62-f3e728c6a310 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:28.410531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b425ed9-7b80-4c40-8e62-f3e728c6a310 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:28.410531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b425ed9-7b80-4c40-8e62-f3e728c6a310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:28.469694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b425ed9-7b80-4c40-8e62-f3e728c6a310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:28.472971 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b425ed9-7b80-4c40-8e62-f3e728c6a310 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:28.506013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1226/2438] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:21:30.306571 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1823-1869-4650-ba3a-f29b00c9237b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:30.307699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1823-1869-4650-ba3a-f29b00c9237b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:30.308162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1823-1869-4650-ba3a-f29b00c9237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:30.370932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e98d1823-1869-4650-ba3a-f29b00c9237b None None] MFA Rules not processed for user `5597f5ffc26041449aeb5750c8845aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:30.372716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e98d1823-1869-4650-ba3a-f29b00c9237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:30.385845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1213/2439] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:38.487753 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:39.409843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:39.410130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:39.410411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:39.433704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] MFA Rules not processed for user `79d9b956f7f14598ae34c492443533f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:39.434902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:39.516187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1227/2440] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:40.356021 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:43.945448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:43.946560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:43.947068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:43.972881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:43.974611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:44.048953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1214/2441] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:44.066541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:44.069385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:44.196334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691467-508b-41ad-b266-bbf2e2a05da8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:44.217529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:44.217529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:44.217529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:44.217529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:44.218865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:44.223075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:44.235137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1228/2442] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:21:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:21:50.028670 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:50.031276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:50.121034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ede7f1-c1af-4e50-8c08-36daf043eddf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:50.126891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:50.127799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:50.128294 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:50.128576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] PATH_INFO: `/v3/users/4302801258614547b55efc95a1951c44` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:50.130162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4302801258614547b55efc95a1951c44)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:50.133733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:50.195124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4302801258614547b55efc95a1951c44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.195848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4302801258614547b55efc95a1951c44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.196475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4302801258614547b55efc95a1951c44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.212198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4302801258614547b55efc95a1951c44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.228255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4302801258614547b55efc95a1951c44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.244162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1215/2443] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:50 2022] DELETE /identity/v3/users/4302801258614547b55efc95a1951c44 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:50.552916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:50.573408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94635388-2de2-40aa-ae85-0491df187cc1 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:50.668750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:50.670807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:50.671163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:50.671539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] PATH_INFO: `/v3/projects/105b8efe222f49bb88cdc3eee7c3d75e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:50.672967 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105b8efe222f49bb88cdc3eee7c3d75e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:50.675057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:50.721606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:50.734439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105b8efe222f49bb88cdc3eee7c3d75e', 'request_id': 'req-6ad661c7-3b71-4b0a-8c90-5a50051d9889'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.743813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105b8efe222f49bb88cdc3eee7c3d75e', 'request_id': 'req-6ad661c7-3b71-4b0a-8c90-5a50051d9889'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.751373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105b8efe222f49bb88cdc3eee7c3d75e', 'request_id': 'req-6ad661c7-3b71-4b0a-8c90-5a50051d9889'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.768679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] The token cache is being invalidate because project 105b8efe222f49bb88cdc3eee7c3d75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:50.768939 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.769663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.771457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1229/2444] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:50 2022] DELETE /identity/v3/projects/105b8efe222f49bb88cdc3eee7c3d75e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:50.775409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:50.777160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:50.792903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56808-4b5d-4a77-94c8-312255d33169 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:50.827511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:50.869735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:50.870647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:50.870937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:50.871200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] PATH_INFO: `/v3/users/3a9a85fe4ded41fab3ed1d8e85ca052c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:50.878832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9a85fe4ded41fab3ed1d8e85ca052c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:50.881101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:50.949819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9a85fe4ded41fab3ed1d8e85ca052c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.950491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9a85fe4ded41fab3ed1d8e85ca052c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.951376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9a85fe4ded41fab3ed1d8e85ca052c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.969093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9a85fe4ded41fab3ed1d8e85ca052c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:50.981964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-579edffc-0089-47c3-9609-9d832eee7757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9a85fe4ded41fab3ed1d8e85ca052c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:51.002010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1216/2445] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:21:50 2022] DELETE /identity/v3/users/3a9a85fe4ded41fab3ed1d8e85ca052c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:51.205162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:51.207088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:51.228668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad661c7-3b71-4b0a-8c90-5a50051d9889 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:51.299600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:51.300543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.300836 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.301150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] PATH_INFO: `/v3/projects/34e0bc76c1b344eb9ecf9f62c1921306` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.302444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e0bc76c1b344eb9ecf9f62c1921306)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:51.304424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:51.371345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e0bc76c1b344eb9ecf9f62c1921306', 'request_id': 'req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:51.385814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e0bc76c1b344eb9ecf9f62c1921306', 'request_id': 'req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:51.400003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e0bc76c1b344eb9ecf9f62c1921306', 'request_id': 'req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:51.420333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] The token cache is being invalidate because project 34e0bc76c1b344eb9ecf9f62c1921306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:21:51.420668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:51.421573 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3a4d30b0-6415-47f1-8e2e-d59f7e4e8f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:21:51.423776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1230/2446] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:21:51 2022] DELETE /identity/v3/projects/34e0bc76c1b344eb9ecf9f62c1921306 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:21:51.429256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.429841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.429933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.450903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:51.452113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:51.535307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1217/2447] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:51.543556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.543847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.544429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.577697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:51.579095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:51.590272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1231/2448] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:51.594830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:51.605750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c261b-d162-4180-985a-dde907ca7e2f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:51.613773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:51.614595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.614969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.615313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.616143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:21:51.616521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:51.618404 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:51.633169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1218/2449] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:21:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:21:51.641491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:51.663662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21352cce-2cbd-4310-8541-7e59f51bca2e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:51.670373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:51.671085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.671369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.671847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.672591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:51.674629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:51.726302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1232/2450] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:21:51 2022] POST /identity/v3/projects => generated 378 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:51.737205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:51.756190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b67bc9-e54d-4546-880a-9dcee0a00e3c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:51.804029 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:51.893341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:51.893341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.893341 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.893747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.894140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:51.896124 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:51.931744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1219/2451] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:21:51 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:21:51.936639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:51.951155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6380-4e20-421d-97a6-4d44aec4a8dd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:51.956731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:51.957538 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.957888 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.958230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.959351 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:51.961074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:51.973398 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1233/2452] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:51 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:51.977585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:51.988484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ee403-ece0-4928-babf-b7ccc191a48b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:51.993511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f47fd6-ef23-4dd0-a4ca-821f40162205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:51.994200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f47fd6-ef23-4dd0-a4ca-821f40162205 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:51.994483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f47fd6-ef23-4dd0-a4ca-821f40162205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:51.994762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f47fd6-ef23-4dd0-a4ca-821f40162205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:51.995514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f47fd6-ef23-4dd0-a4ca-821f40162205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:51.997173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f47fd6-ef23-4dd0-a4ca-821f40162205 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:52.008827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1220/2453] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:21:51 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:21:52.013216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:52.040206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e36cf-8faa-4377-bf7f-bf68eb51c6d9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:52.046842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:52.047799 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:52.048105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:52.048365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] PATH_INFO: `/v3/projects/90ceb6f907424e008ee2c5b20801bb51/users/25be08b5f7614d9e96d1cf7dcfb70cb3/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:52.066849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:52.070765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ceb6f907424e008ee2c5b20801bb51, user_id=25be08b5f7614d9e96d1cf7dcfb70cb3, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:52.080447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:52.101789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1234/2454] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:21:52 2022] PUT /identity/v3/projects/90ceb6f907424e008ee2c5b20801bb51/users/25be08b5f7614d9e96d1cf7dcfb70cb3/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:21:52.112169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:52.112453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:52.112735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:52.147882 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] MFA Rules not processed for user `25be08b5f7614d9e96d1cf7dcfb70cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:52.149205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:52.239579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1221/2455] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:52.249069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:52.250380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:52.325550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fff6f-abf6-47b0-901e-13cc3f49a827 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:52.329803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b8f43-8193-4738-95f4-0e181a36e52d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:52.330471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8f43-8193-4738-95f4-0e181a36e52d service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:52.330764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8f43-8193-4738-95f4-0e181a36e52d service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:52.331019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b8f43-8193-4738-95f4-0e181a36e52d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:52.340880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b8f43-8193-4738-95f4-0e181a36e52d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:52.342834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b8f43-8193-4738-95f4-0e181a36e52d service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:52.354267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1235/2456] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:22:02.231718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:02.349407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:04.619192 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:04.701181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2de3-a4d5-434f-b097-5482adba701d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:04.709033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:04.710013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:04.710494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:04.710782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] PATH_INFO: `/v3/users/25be08b5f7614d9e96d1cf7dcfb70cb3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:04.712617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=25be08b5f7614d9e96d1cf7dcfb70cb3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:04.715078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:04.798530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25be08b5f7614d9e96d1cf7dcfb70cb3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:04.799640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25be08b5f7614d9e96d1cf7dcfb70cb3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:04.800492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25be08b5f7614d9e96d1cf7dcfb70cb3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:04.819956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25be08b5f7614d9e96d1cf7dcfb70cb3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:04.837555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25be08b5f7614d9e96d1cf7dcfb70cb3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:04.865983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1222/2457] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:22:04 2022] DELETE /identity/v3/users/25be08b5f7614d9e96d1cf7dcfb70cb3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:22:04.871708 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:04.872323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:04.872595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:04.896685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:04.898124 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:04.988552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1236/2458] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:22:05.005873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:05.007511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:05.113584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3f493-03c7-43e6-b319-63a4590fdfbe admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:05.119146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa6c88-a10f-44fd-80b6-b6f729204d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:05.119921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa6c88-a10f-44fd-80b6-b6f729204d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:05.120255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa6c88-a10f-44fd-80b6-b6f729204d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:05.120604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa6c88-a10f-44fd-80b6-b6f729204d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:05.132280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa6c88-a10f-44fd-80b6-b6f729204d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:05.133895 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa6c88-a10f-44fd-80b6-b6f729204d6e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:05.145899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1223/2459] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:22:05.488150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:05.489653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:05.503067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4e1c-5573-4e80-bb1f-13af7807dc69 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:05.509651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:05.511178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:05.511178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:05.511178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] PATH_INFO: `/v3/projects/90ceb6f907424e008ee2c5b20801bb51` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:05.512469 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ceb6f907424e008ee2c5b20801bb51)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:05.514502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:05.602874 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ceb6f907424e008ee2c5b20801bb51', 'request_id': 'req-929998f8-af09-49e9-aac1-5e01a4ca8970'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:05.619005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ceb6f907424e008ee2c5b20801bb51', 'request_id': 'req-929998f8-af09-49e9-aac1-5e01a4ca8970'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:05.626697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ceb6f907424e008ee2c5b20801bb51', 'request_id': 'req-929998f8-af09-49e9-aac1-5e01a4ca8970'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:05.646175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] The token cache is being invalidate because project 90ceb6f907424e008ee2c5b20801bb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:22:05.646175 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:05.648599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-929998f8-af09-49e9-aac1-5e01a4ca8970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:05.652376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1237/2460] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:22:05 2022] DELETE /identity/v3/projects/90ceb6f907424e008ee2c5b20801bb51 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:22:06.167936 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:06.168472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:06.168472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:06.190968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] MFA Rules not processed for user `5a1a910de31044ab9c8dcfb2bb4651c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:06.192078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:06.211817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:06.257397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1224/2461] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:06.813771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b910-7406-4033-a8b0-fa9820637db8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:06.814554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b910-7406-4033-a8b0-fa9820637db8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:06.814554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b910-7406-4033-a8b0-fa9820637db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:06.841727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d6d5b910-7406-4033-a8b0-fa9820637db8 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:06.844103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d6d5b910-7406-4033-a8b0-fa9820637db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:06.940228 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1238/2462] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:06.954009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:06.955629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:07.050631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e085f8-3450-4f0c-95f1-4917f35b5f02 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:07.056289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:07.057215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:07.057459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:07.057736 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:07.069880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:07.072876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:07.091603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1225/2463] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:22:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 19:22:07.775066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3ee37-f242-49d5-923e-49f22aea0d0d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:07.775360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3ee37-f242-49d5-923e-49f22aea0d0d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:07.775635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3ee37-f242-49d5-923e-49f22aea0d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:07.799715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f6e3ee37-f242-49d5-923e-49f22aea0d0d None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:07.801088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f6e3ee37-f242-49d5-923e-49f22aea0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:07.808633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1239/2464] 10.222.0.113 () {58 vars in 972 bytes} [Mon Jul 25 19:22:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:07.821787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:07.833651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d422-6930-4fd8-95d9-22e55d68255d service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:07.838733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:07.839391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:07.839683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:07.839957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:07.849557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:07.851236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:07.860680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1226/2465] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:22:08.158908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4155d55-6ec7-4b5e-82cc-76a27054424e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:08.159626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4155d55-6ec7-4b5e-82cc-76a27054424e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:08.159626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4155d55-6ec7-4b5e-82cc-76a27054424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:08.183749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a4155d55-6ec7-4b5e-82cc-76a27054424e None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:08.185241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a4155d55-6ec7-4b5e-82cc-76a27054424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:08.198218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1240/2466] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:22:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:08.216270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:08.246715 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76829b1c-bf14-4b89-84ae-5862c4105d61 service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:08.266183 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:08.266899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:08.267359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:08.267795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:08.278324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:08.280324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:08.294494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1227/2467] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:22:08.742755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:08.743050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:08.743331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:08.765238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:08.766831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:08.776681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1241/2468] 10.222.0.113 () {58 vars in 972 bytes} [Mon Jul 25 19:22:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:08.789764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:08.805693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0060e2-1e75-428d-ba80-925382c072f0 service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:08.811491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048fc6c-6fe7-4e70-bbe9-6f65d3222835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:08.812200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048fc6c-6fe7-4e70-bbe9-6f65d3222835 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:08.812466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048fc6c-6fe7-4e70-bbe9-6f65d3222835 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:08.812738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048fc6c-6fe7-4e70-bbe9-6f65d3222835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:08.822841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048fc6c-6fe7-4e70-bbe9-6f65d3222835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:08.824371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048fc6c-6fe7-4e70-bbe9-6f65d3222835 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:08.834116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1228/2469] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:22:11.214899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:11.216671 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:11.233141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:11.301396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9297-8d64-414d-8676-a59bbd8d21b9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:11.310019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:11.311349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:11.312068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:11.312358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] PATH_INFO: `/v3/users/5597f5ffc26041449aeb5750c8845aaf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:11.313679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5597f5ffc26041449aeb5750c8845aaf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:11.315651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:11.377587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5597f5ffc26041449aeb5750c8845aaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.392313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5597f5ffc26041449aeb5750c8845aaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.393099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5597f5ffc26041449aeb5750c8845aaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.402174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5597f5ffc26041449aeb5750c8845aaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.402787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5597f5ffc26041449aeb5750c8845aaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.416580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1242/2470] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:22:11 2022] DELETE /identity/v3/users/5597f5ffc26041449aeb5750c8845aaf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:22:11.421308 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:11.421809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:11.421902 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:11.442091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:11.443355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:11.514090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1229/2471] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:11.524319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:11.526667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:11.593773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965ee4-d7c6-47c7-9c38-507394c7201f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:11.598375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:11.599052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:11.599334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:11.599604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:11.615217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:11.616696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:11.627540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1243/2472] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:22:11.836676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:11.839024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:11.863461 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e04b4d-4410-4957-80b1-08f3f28f8538 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:11.874286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:11.875363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:11.875651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:11.884244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] PATH_INFO: `/v3/projects/accf2f018e1849839ac934f81af2fe5d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:11.887888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accf2f018e1849839ac934f81af2fe5d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:11.887888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:11.904238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:11.962303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accf2f018e1849839ac934f81af2fe5d', 'request_id': 'req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.972037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accf2f018e1849839ac934f81af2fe5d', 'request_id': 'req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:11.981540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accf2f018e1849839ac934f81af2fe5d', 'request_id': 'req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:12.011207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] The token cache is being invalidate because project accf2f018e1849839ac934f81af2fe5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:22:12.011675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:12.012516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:22:12.014735 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1230/2473] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:22:11 2022] DELETE /identity/v3/projects/accf2f018e1849839ac934f81af2fe5d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:22:17.625426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:17.627080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:17.692409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:17.783069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ae31-0ecc-465b-9b23-ddb888c426b9 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:17.893961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:17.895163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:17.895606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:17.895991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:17.898471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:17.920160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:17.922040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e86681-0136-4d64-9b40-479af98cdd43 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:17.937353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1244/2474] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:22:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:22:18.630265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:18.631782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:18.694113 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b9a6-a295-4afe-8640-ca13cb0a00b0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:18.697661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:18.698318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:18.698602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:18.698878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:18.700658 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:18.772538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:18.774049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd8429-049d-4bc4-9b85-900e423ff60d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:18.784423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1231/2475] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:22:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:22:27.932399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=44 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:28.779683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:28.847272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2137-b0ad-439d-8fd9-99afe65459da None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:28.847567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2137-b0ad-439d-8fd9-99afe65459da None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:28.847848 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2137-b0ad-439d-8fd9-99afe65459da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:28.869738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-45bf2137-b0ad-439d-8fd9-99afe65459da None None] MFA Rules not processed for user `f99afdfcdd32429f88a03a06dd71453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:22:28.871287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-45bf2137-b0ad-439d-8fd9-99afe65459da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:22:28.929137 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1245/2476] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:22:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:22:38.921846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:42.977752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bb61d-8899-49f1-b66e-8543662e02ac None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:23:42.978360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bb61d-8899-49f1-b66e-8543662e02ac None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:23:42.978360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bb61d-8899-49f1-b66e-8543662e02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:23:42.998402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ea8bb61d-8899-49f1-b66e-8543662e02ac None None] MFA Rules not processed for user `5a1a910de31044ab9c8dcfb2bb4651c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:23:42.999719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ea8bb61d-8899-49f1-b66e-8543662e02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:23:43.072962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1232/2477] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:23:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:23:53.064710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=25 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:23:53.819484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:23:53.820076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:23:53.820076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:23:53.841022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] MFA Rules not processed for user `113a0a0591384937ae2408f468be8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:23:53.842492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:23:53.906038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1246/2478] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:23:57.657862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:23:57.658477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:23:57.658623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:23:57.685769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] MFA Rules not processed for user `f99afdfcdd32429f88a03a06dd71453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:23:57.687116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:23:57.699878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1233/2479] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:23:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:03.904066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:07.680422 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:13.223297 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:13.224911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:13.285453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161848-4428-42ee-ac87-74e2ab75efef None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:13.289191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:13.289878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:13.290316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:13.290592 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:13.292410 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:13.365455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:13.366846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ca68-a660-4d98-87ec-2d9d40d25e33 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:13.383422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1247/2480] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:17.258967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:17.270212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6a48-df31-46dd-a9f5-37b73298192d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:17.276222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:17.277175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:17.277561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:17.277955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:17.281599 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:17.301921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:17.303412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:17.314978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1234/2481] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:24:20.862617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebe5e-e97d-42dd-8ae2-1bed4a3387cb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:20.863147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebe5e-e97d-42dd-8ae2-1bed4a3387cb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:20.863147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebe5e-e97d-42dd-8ae2-1bed4a3387cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:20.883299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-aedebe5e-e97d-42dd-8ae2-1bed4a3387cb None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:24:20.884516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aedebe5e-e97d-42dd-8ae2-1bed4a3387cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:20.952136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1248/2482] 10.222.0.113 () {58 vars in 972 bytes} [Mon Jul 25 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:21.004489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:21.005965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:21.076244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ce63-9b78-450c-8f5a-ff8e87d235b2 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:21.082501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907143f0-f49e-4c07-87d7-4f5c5364fa50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:21.083245 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907143f0-f49e-4c07-87d7-4f5c5364fa50 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:21.083531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907143f0-f49e-4c07-87d7-4f5c5364fa50 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:21.083836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907143f0-f49e-4c07-87d7-4f5c5364fa50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:21.092395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907143f0-f49e-4c07-87d7-4f5c5364fa50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:21.094523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907143f0-f49e-4c07-87d7-4f5c5364fa50 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:21.102588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1235/2483] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:24:24.621620 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875730bf-6f12-47b6-b40a-da26c1ae1b0a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:24.622236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875730bf-6f12-47b6-b40a-da26c1ae1b0a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:24.622236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875730bf-6f12-47b6-b40a-da26c1ae1b0a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:24.623616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1249/2484] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:24:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:24:24.650063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:24.650582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:24.650685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:24.671944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] MFA Rules not processed for user `24596930fed646f6ba8ea30e43dbbcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:24:24.673474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:24.682432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1236/2485] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:24:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:24.706894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875730bf-6f12-47b6-b40a-da26c1ae1b0a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:24.709075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-875730bf-6f12-47b6-b40a-da26c1ae1b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:24.727865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875730bf-6f12-47b6-b40a-da26c1ae1b0a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:24.733656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35378061-5809-49ff-9584-a49795b57651 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:24.734504 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35378061-5809-49ff-9584-a49795b57651 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:24.734940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35378061-5809-49ff-9584-a49795b57651 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:24.735226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35378061-5809-49ff-9584-a49795b57651 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:24.748062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35378061-5809-49ff-9584-a49795b57651 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:24.749972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35378061-5809-49ff-9584-a49795b57651 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:24.760012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1250/2486] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:28.035108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:28.046603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f343a0-95e8-41b1-9f29-aaaa60536440 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:28.051845 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:28.052496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:28.053602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:28.053743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:28.055924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:28.072501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:28.074813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:28.092263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1237/2487] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:28.100386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35378061-5809-49ff-9584-a49795b57651 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:28.102719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-35378061-5809-49ff-9584-a49795b57651 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:28.158354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:28.188135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35378061-5809-49ff-9584-a49795b57651 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:28.192637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:28.193558 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:28.193842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:28.194119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] PATH_INFO: `/v3/users/79d9b956f7f14598ae34c492443533f0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:28.195323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d9b956f7f14598ae34c492443533f0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:28.197310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:28.252833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d9b956f7f14598ae34c492443533f0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.265490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d9b956f7f14598ae34c492443533f0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.266171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d9b956f7f14598ae34c492443533f0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.274795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d9b956f7f14598ae34c492443533f0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.275590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d9b956f7f14598ae34c492443533f0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.289319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1251/2488] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:24:28 2022] DELETE /identity/v3/users/79d9b956f7f14598ae34c492443533f0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:24:28.483666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:28.497041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f312b6-8d3d-40d6-808d-5f1a9b6df3c7 service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:28.557809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:28.558671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:28.558950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:28.559224 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] PATH_INFO: `/v3/projects/b0a2fa78de7f441e947dccd498f9877a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:28.560490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a2fa78de7f441e947dccd498f9877a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:28.563009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:28.614240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a2fa78de7f441e947dccd498f9877a', 'request_id': 'req-d2f635c5-f741-4548-a964-3c6fb111d9c3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.624149 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a2fa78de7f441e947dccd498f9877a', 'request_id': 'req-d2f635c5-f741-4548-a964-3c6fb111d9c3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.626363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:28.630847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a2fa78de7f441e947dccd498f9877a', 'request_id': 'req-d2f635c5-f741-4548-a964-3c6fb111d9c3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.643069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] The token cache is being invalidate because project b0a2fa78de7f441e947dccd498f9877a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:24:28.643354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.643994 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.645584 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1238/2489] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:24:28 2022] DELETE /identity/v3/projects/b0a2fa78de7f441e947dccd498f9877a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:24:28.649587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:28.651017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:28.664475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5fe3-2792-4870-a850-7285fba4ca45 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:28.733714 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:28.734576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:28.734892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:28.735176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] PATH_INFO: `/v3/users/3183b56a309547ee9299752f386b4416` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:28.736436 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3183b56a309547ee9299752f386b4416)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:28.738481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:28.791697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3183b56a309547ee9299752f386b4416'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.797040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:28.804881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3183b56a309547ee9299752f386b4416'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.805622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3183b56a309547ee9299752f386b4416'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.814361 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3183b56a309547ee9299752f386b4416'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.815196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3183b56a309547ee9299752f386b4416'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:28.828006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1252/2490] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:24:28 2022] DELETE /identity/v3/users/3183b56a309547ee9299752f386b4416 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:24:29.009614 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:29.011071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:29.024432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f635c5-f741-4548-a964-3c6fb111d9c3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:29.085097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:29.085998 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:29.086284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:29.086562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] PATH_INFO: `/v3/projects/dc3fd01cad76444ebbdbd3d7688a9c8f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:29.087824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3fd01cad76444ebbdbd3d7688a9c8f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:29.089804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:29.140028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3fd01cad76444ebbdbd3d7688a9c8f', 'request_id': 'req-e39453d2-0710-45ed-88a3-ebd71fdce714'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:29.148849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3fd01cad76444ebbdbd3d7688a9c8f', 'request_id': 'req-e39453d2-0710-45ed-88a3-ebd71fdce714'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:29.154368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3fd01cad76444ebbdbd3d7688a9c8f', 'request_id': 'req-e39453d2-0710-45ed-88a3-ebd71fdce714'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:29.165635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] The token cache is being invalidate because project dc3fd01cad76444ebbdbd3d7688a9c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:24:29.165927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:29.166636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:29.168280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1239/2491] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:24:29 2022] DELETE /identity/v3/projects/dc3fd01cad76444ebbdbd3d7688a9c8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:24:38.824421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=10,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:39.162694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=56,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:48.443562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:48.445226 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:48.540295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8d810-f6b5-43fc-89ac-53461a8997c5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:48.615517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:48.616110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:48.616394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:48.616670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:48.618727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:48.632831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:48.634501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:48.645325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1253/2492] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:24:53.922731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:53.924366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:53.941852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39453d2-0710-45ed-88a3-ebd71fdce714 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:53.948173 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:53.948837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:53.949144 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:53.949430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:53.951684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:54.013073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:54.014940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:54.024782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1240/2493] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:57.344217 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:57.356077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74482fbb-7934-47af-997a-cc6c02dd0c35 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:57.363543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:57.364439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:57.364744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:57.365017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:57.367118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:57.462709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:57.463882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:57.476176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1254/2494] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:59.124265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:59.126108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:59.215142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cec025-dab5-4462-ae41-40d08f64146e service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:59.220014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:59.220887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.221194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.221473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] PATH_INFO: `/v3/users/5a1a910de31044ab9c8dcfb2bb4651c6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.222776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1a910de31044ab9c8dcfb2bb4651c6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:59.224696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:59.279638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1a910de31044ab9c8dcfb2bb4651c6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.280365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1a910de31044ab9c8dcfb2bb4651c6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.281232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1a910de31044ab9c8dcfb2bb4651c6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.297996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1a910de31044ab9c8dcfb2bb4651c6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.305871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0356a37b-0c79-40db-bc3d-c9045075c6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1a910de31044ab9c8dcfb2bb4651c6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.321996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1241/2495] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:24:59 2022] DELETE /identity/v3/users/5a1a910de31044ab9c8dcfb2bb4651c6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:24:59.520938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:59.554350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb4c3-18fa-47d6-bff1-cc41b8b074b8 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:59.576847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:59.633237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:59.634160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.634451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.634730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] PATH_INFO: `/v3/projects/3ad3d0f1e92d4d92bb12ba8505a0e779` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.635973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad3d0f1e92d4d92bb12ba8505a0e779)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:59.638107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:59.685417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad3d0f1e92d4d92bb12ba8505a0e779', 'request_id': 'req-76a23841-1fce-496b-a29a-21deb5f4e6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.694063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad3d0f1e92d4d92bb12ba8505a0e779', 'request_id': 'req-76a23841-1fce-496b-a29a-21deb5f4e6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.699657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad3d0f1e92d4d92bb12ba8505a0e779', 'request_id': 'req-76a23841-1fce-496b-a29a-21deb5f4e6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.711204 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] The token cache is being invalidate because project 3ad3d0f1e92d4d92bb12ba8505a0e779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:24:59.711492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.712163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76a23841-1fce-496b-a29a-21deb5f4e6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:24:59.713747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1255/2496] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:24:59 2022] DELETE /identity/v3/projects/3ad3d0f1e92d4d92bb12ba8505a0e779 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:24:59.719677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.720048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.720428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.749477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:24:59.750691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:59.764142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:59.815505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1242/2497] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:59.827283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.827591 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.827935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.853787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:24:59.855007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:59.867755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1256/2498] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:59.872827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:59.883544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af52c43-a8e6-4f3d-8d45-17dde8209743 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:59.889606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:59.890270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.890559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.890835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.891682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:24:59.891992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:59.893651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:59.906206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1243/2499] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:24:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:24:59.910883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:59.920803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e163db5-8773-494e-8534-6fe657a26b56 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:59.926915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:59.927772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.928028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.928682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.930537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:59.933168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:59.972313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1257/2500] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:24:59 2022] POST /identity/v3/projects => generated 390 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:24:59.974269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:59.985207 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1249d7-af73-4bf0-9f75-b15fc8f8e8b7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:00.048079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:00.048891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:00.049351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:00.049647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:00.050359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:00.052315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:00.075298 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1244/2501] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:24:59 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:00.079599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:00.090414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b17dd-a4ee-4955-99a7-67f819e781c3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:00.095382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:00.096064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:00.096358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:00.096640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:00.097420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:00.099043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:00.112649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1258/2502] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:00 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:00.113693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:00.124094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691947-8093-422d-ac7f-c005f0aeed47 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:00.129001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfe4f2-41aa-4f82-9d84-c13f77631300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:00.129696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfe4f2-41aa-4f82-9d84-c13f77631300 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:00.129991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfe4f2-41aa-4f82-9d84-c13f77631300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:00.130274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfe4f2-41aa-4f82-9d84-c13f77631300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:00.131171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfe4f2-41aa-4f82-9d84-c13f77631300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:00.132810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfe4f2-41aa-4f82-9d84-c13f77631300 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:00.144078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1245/2503] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:00 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:00.148368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:00.158801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7822f-fe00-4715-ba48-66a7d3fcf2c2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:00.163547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:00.164442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:00.164728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:00.165006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] PATH_INFO: `/v3/projects/38abbc7a672e49edaf9be58c6253248e/users/d64b7e00cfd748f9b0497c977cc08d26/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:00.180442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38abbc7a672e49edaf9be58c6253248e, user_id=d64b7e00cfd748f9b0497c977cc08d26, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:00.183157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:00.198309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1259/2504] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:00 2022] PUT /identity/v3/projects/38abbc7a672e49edaf9be58c6253248e/users/d64b7e00cfd748f9b0497c977cc08d26/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:00.203963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aab86-a2aa-4896-9f9e-49778730035f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:00.204546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aab86-a2aa-4896-9f9e-49778730035f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:00.204830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aab86-a2aa-4896-9f9e-49778730035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:00.224174 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-175aab86-a2aa-4896-9f9e-49778730035f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:00.225463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-175aab86-a2aa-4896-9f9e-49778730035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:00.289430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1246/2505] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:00.296245 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:00.298269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:00.361074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:00.365823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81b72-3c9c-41aa-9876-1e54e56827c3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:00.376180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:00.377555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:00.377849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:00.378128 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:00.393048 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:00.394904 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:00.406517 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1260/2506] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:05.135615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584afc5-2d5e-4cfa-9275-098b49c57b0c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:05.136082 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584afc5-2d5e-4cfa-9275-098b49c57b0c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:05.136212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584afc5-2d5e-4cfa-9275-098b49c57b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:05.166332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5584afc5-2d5e-4cfa-9275-098b49c57b0c None None] MFA Rules not processed for user `d64b7e00cfd748f9b0497c977cc08d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:05.167692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5584afc5-2d5e-4cfa-9275-098b49c57b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:05.199016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:05.287582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1247/2507] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:05.302303 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:05.303810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:05.397586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9fdd-d9ad-4900-8508-10d464a75c05 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:05.404486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:05.405223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:05.405685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:05.405980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:05.415419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:05.417089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:05.428515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1261/2508] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:07.332977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:07.333509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:07.333596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:07.355386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] MFA Rules not processed for user `d64b7e00cfd748f9b0497c977cc08d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:07.357409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:07.380595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1248/2509] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:07.787666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:07.791424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:07.809238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb54447-0536-4b8d-a159-263747ca1d73 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:07.815274 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:07.816211 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:07.816722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:07.817273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:07.819362 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:07.835298 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:07.836768 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:07.846747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1262/2510] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:08.271526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:08.273032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:08.365591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112cf80-0ae8-41b9-8c97-491d5d40d566 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:08.371939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:08.372663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:08.373164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:08.373653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:08.375721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:08.403673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:08.405462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:08.419825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1249/2511] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:11.630970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:11.647814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7639508-4fa7-4490-a46f-64eead3dc93e service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:11.661629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:11.662452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:11.662840 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:11.663220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:11.665560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:11.715786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:11.722141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:11.761832 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1263/2512] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:12.564872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:12.596391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bdaf7-75ac-4022-877f-b01c34af6a9a service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:12.604193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:12.605912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:12.606403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:12.607072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:12.609632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:12.633481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:12.635408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:12.658379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1250/2513] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:13.144894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:13.156749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3f55a-5611-4930-8898-dbd70fbd37c6 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:13.159290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:13.159290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:13.159506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:13.159834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:13.161880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:13.177326 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:13.180131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:13.195236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1264/2514] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:16.843110 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:16.844671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:16.860214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c60c53-09da-417f-8228-07885ad11d42 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:16.865452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:16.866466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:16.866822 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:16.867168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] PATH_INFO: `/v3/users/f99afdfcdd32429f88a03a06dd71453e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:16.868484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99afdfcdd32429f88a03a06dd71453e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:16.870604 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:16.928466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99afdfcdd32429f88a03a06dd71453e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:16.929342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99afdfcdd32429f88a03a06dd71453e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:16.929816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99afdfcdd32429f88a03a06dd71453e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:16.943277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99afdfcdd32429f88a03a06dd71453e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:16.956612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-428ce3b2-35a4-4abe-9c3f-b2b7239b3b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99afdfcdd32429f88a03a06dd71453e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:16.963348 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:16.981209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1251/2515] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:16 2022] DELETE /identity/v3/users/f99afdfcdd32429f88a03a06dd71453e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:17.167251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.188028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc5981-a14e-4fb0-a46e-54a2dcc6c90e service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.250991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.251744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.252016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.252311 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] PATH_INFO: `/v3/projects/cf0dd2da9f9c47b3a2d28a64950935aa` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.253606 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0dd2da9f9c47b3a2d28a64950935aa)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.255508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.299651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:17.308954 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0dd2da9f9c47b3a2d28a64950935aa', 'request_id': 'req-f7a4f612-f35a-4984-bfdf-b3b8389ea258'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:17.320835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0dd2da9f9c47b3a2d28a64950935aa', 'request_id': 'req-f7a4f612-f35a-4984-bfdf-b3b8389ea258'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:17.327344 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0dd2da9f9c47b3a2d28a64950935aa', 'request_id': 'req-f7a4f612-f35a-4984-bfdf-b3b8389ea258'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:17.339559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] The token cache is being invalidate because project cf0dd2da9f9c47b3a2d28a64950935aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:17.340070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:17.340885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:17.342575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1265/2516] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:17 2022] DELETE /identity/v3/projects/cf0dd2da9f9c47b3a2d28a64950935aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:17.349479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d9b63-0d56-4b57-bfea-083a2736324d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.349479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d9b63-0d56-4b57-bfea-083a2736324d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.349479 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d9b63-0d56-4b57-bfea-083a2736324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.372865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fb7d9b63-0d56-4b57-bfea-083a2736324d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:17.374159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb7d9b63-0d56-4b57-bfea-083a2736324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:17.399161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.401547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:17.442167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1252/2517] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:17.450872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.451197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.451446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.470253 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f612-f35a-4984-bfdf-b3b8389ea258 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.474847 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.475537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.475820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.476101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.481080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:17.481655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:17.482478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:17.494566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1253/2518] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:17.498643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.498965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.500257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.508320 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900390b-97f8-47d0-9632-270a1a9b3854 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.514183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1266/2519] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:25:17.514444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.515237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.515533 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.515874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.516688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:17.517052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.518756 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.533484 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1254/2520] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:25:17.537804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.548021 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30004ce-cdb4-40a0-b536-02766190fc13 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.553500 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.554249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.554452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.554732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.555527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.557406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.591765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1267/2521] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:17 2022] POST /identity/v3/projects => generated 378 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:17.592739 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.605423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d285-5925-4cfe-8370-8faf062d4f25 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.675129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.676158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.676612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.677042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.677932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.680663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.712640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1255/2522] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:17 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:17.716482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.727672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff8eca-26d9-481a-9a99-c44e5772d680 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.733352 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.734143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.734501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.734846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.735662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.737382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.769605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1268/2523] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:17 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:25:17.770742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.781498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186de5b6-d4d5-4a5b-80e2-9f0db398add0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.786941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278eee3-66bb-4416-9e21-8b9f069edbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.787619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278eee3-66bb-4416-9e21-8b9f069edbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.787903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278eee3-66bb-4416-9e21-8b9f069edbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.788181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278eee3-66bb-4416-9e21-8b9f069edbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.788920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278eee3-66bb-4416-9e21-8b9f069edbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.790569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278eee3-66bb-4416-9e21-8b9f069edbe3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.803640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1256/2524] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:17 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:17.807622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:17.817957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e807-b9bd-4339-8b2b-f67168949253 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:17.822890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:17.823793 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.824145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.824423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] PATH_INFO: `/v3/projects/0c8070fbc65b477bb734cf568019bbe2/users/7ad7c43573de457e9e1ec4551f670b6d/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.847875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8070fbc65b477bb734cf568019bbe2, user_id=7ad7c43573de457e9e1ec4551f670b6d, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:17.852522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:17.883057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1269/2525] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:17 2022] PUT /identity/v3/projects/0c8070fbc65b477bb734cf568019bbe2/users/7ad7c43573de457e9e1ec4551f670b6d/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:17.889248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:17.889764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:17.889848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:17.946279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] MFA Rules not processed for user `7ad7c43573de457e9e1ec4551f670b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:17.961368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:18.008255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:18.032522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1257/2526] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:18.044067 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:18.046160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:18.108014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053f79e-c367-41a6-affb-493dc3dd9821 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:18.111835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:18.112505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:18.112789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:18.113064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:18.122328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:18.123803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:18.133528 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1270/2527] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:18.626306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:18.628680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:18.746072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2d3f-572d-490e-8bb6-9f0ce856baaa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:18.751830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:18.752528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:18.752809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:18.753087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:18.754987 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:18.768635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:18.770406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:18.782453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1258/2528] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:21.192386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:21.200341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:21.225236 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:21.294292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64fca-8614-44b6-8f61-70788fb3096c service glance] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:21.299000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:21.299884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:21.300161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:21.300428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] PATH_INFO: `/v3/users/113a0a0591384937ae2408f468be8e79` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:21.301696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113a0a0591384937ae2408f468be8e79)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:21.303634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:21.359443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113a0a0591384937ae2408f468be8e79'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.372184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113a0a0591384937ae2408f468be8e79'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.372880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113a0a0591384937ae2408f468be8e79'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.381439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113a0a0591384937ae2408f468be8e79'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.382181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-400d9cf2-a787-4967-8410-3f4f8a042fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113a0a0591384937ae2408f468be8e79'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.395823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1271/2529] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:21 2022] DELETE /identity/v3/users/113a0a0591384937ae2408f468be8e79 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:21.597313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:21.608747 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad0fef-7ced-4cc0-a19f-ad7e6407e8ab service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:21.669345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:21.670252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:21.670540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:21.670821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] PATH_INFO: `/v3/projects/78d0c377e85147c5b8e700039a88ba0c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:21.672145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d0c377e85147c5b8e700039a88ba0c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:21.674251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:21.725720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d0c377e85147c5b8e700039a88ba0c', 'request_id': 'req-4b028902-efbd-48d5-870c-0204502fd522'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.734655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d0c377e85147c5b8e700039a88ba0c', 'request_id': 'req-4b028902-efbd-48d5-870c-0204502fd522'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.742009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d0c377e85147c5b8e700039a88ba0c', 'request_id': 'req-4b028902-efbd-48d5-870c-0204502fd522'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.751556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:21.755791 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] The token cache is being invalidate because project 78d0c377e85147c5b8e700039a88ba0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:21.756093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.757415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4b028902-efbd-48d5-870c-0204502fd522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:21.759203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1259/2530] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:21 2022] DELETE /identity/v3/projects/78d0c377e85147c5b8e700039a88ba0c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:21.764800 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:21.765096 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:21.765411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:21.793740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:21.795053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:21.880614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1272/2531] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:21.888890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:21.889226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:21.889495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:21.910340 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:21.911595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:21.920598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1260/2532] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:21.924964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:21.935761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe222e9-d2c7-4c0f-b979-95041b51f965 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:21.940977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:21.941707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:21.941996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:21.942277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:21.943012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:21.943324 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:21.945056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:21.961533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1273/2533] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:25:21.962683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:21.972481 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801082e-a51e-46e9-89a6-16bcbe522b01 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:21.977442 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:21.978102 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:21.978390 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:21.978666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:21.979372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:21.981357 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:22.012787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1261/2534] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:21 2022] POST /identity/v3/projects => generated 374 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:22.017209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:22.028197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf232-d94a-4b96-b6c3-229ef1eca31d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:22.052931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:22.097726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:22.098421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:22.098724 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:22.098989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:22.099707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:22.102013 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:22.127841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1274/2535] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:22 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:22.129381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:22.140651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fed880-5cf5-49c3-b238-e8af98654800 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:22.145497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:22.146159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:22.146441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:22.146899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:22.147719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:22.150349 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:22.162574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1262/2536] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:22 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:22.166626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:22.177716 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0f00-7788-4c71-a5cc-243136d90ce7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:22.182531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbae8e-d4db-4416-a7d2-f480a7ba2624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:22.183238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbae8e-d4db-4416-a7d2-f480a7ba2624 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:22.183575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbae8e-d4db-4416-a7d2-f480a7ba2624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:22.183883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbae8e-d4db-4416-a7d2-f480a7ba2624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:22.184663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbae8e-d4db-4416-a7d2-f480a7ba2624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:22.186339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbae8e-d4db-4416-a7d2-f480a7ba2624 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:22.198102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1275/2537] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:22 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:22.202506 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:22.213969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efe2c9-6fc9-49fd-a35d-7578d8570051 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:22.219284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:22.220190 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:22.220474 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:22.220750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] PATH_INFO: `/v3/projects/ee0041a1196e4b54b457f1b66d6f721b/users/4b2b77347c5341579d8a04d738205066/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:22.241277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0041a1196e4b54b457f1b66d6f721b, user_id=4b2b77347c5341579d8a04d738205066, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:22.244215 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:22.259288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1263/2538] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:22 2022] PUT /identity/v3/projects/ee0041a1196e4b54b457f1b66d6f721b/users/4b2b77347c5341579d8a04d738205066/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:22.270982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:22.271282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:22.271567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:22.302841 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] MFA Rules not processed for user `4b2b77347c5341579d8a04d738205066`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:22.304075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:22.379693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1276/2539] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:22.391365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:22.393376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:22.477559 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580cb0b-38ee-40df-9644-cdee5bb42902 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:22.483673 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b0078-d340-4c20-9851-a0615c128409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:22.484459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b0078-d340-4c20-9851-a0615c128409 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:22.484774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b0078-d340-4c20-9851-a0615c128409 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:22.485068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b0078-d340-4c20-9851-a0615c128409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:22.497306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b0078-d340-4c20-9851-a0615c128409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:22.498938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b0078-d340-4c20-9851-a0615c128409 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:22.509150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1264/2540] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:25.251777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:25.319167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713edd3-e938-429b-8557-13f3259bc04a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:25.324545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:25.325404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:25.325689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:25.325965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] PATH_INFO: `/v3/users/4b2b77347c5341579d8a04d738205066` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:25.327250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2b77347c5341579d8a04d738205066)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:25.329594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:25.376995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:25.386652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2b77347c5341579d8a04d738205066'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:25.403156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2b77347c5341579d8a04d738205066'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:25.403956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2b77347c5341579d8a04d738205066'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:25.413999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2b77347c5341579d8a04d738205066'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:25.414650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2b77347c5341579d8a04d738205066'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:25.427416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1277/2541] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:25 2022] DELETE /identity/v3/users/4b2b77347c5341579d8a04d738205066 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:25.432033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:25.432580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:25.432580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:25.456737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:25.458034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:25.523996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1265/2542] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:25.534784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:25.536382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:25.601401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fc75-6303-47c3-aa43-b6995967b96d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:25.606173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43238dd1-8743-4052-9b7d-7382cfaefeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:25.606846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43238dd1-8743-4052-9b7d-7382cfaefeff service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:25.607131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43238dd1-8743-4052-9b7d-7382cfaefeff service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:25.607408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43238dd1-8743-4052-9b7d-7382cfaefeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:25.617905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43238dd1-8743-4052-9b7d-7382cfaefeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:25.619525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43238dd1-8743-4052-9b7d-7382cfaefeff service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:25.630948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1278/2543] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:25.917796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:25.919659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:25.935342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0147d1a-9d4e-48a2-a48b-b679896093e7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:25.940963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:25.942041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:25.942472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:25.942799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] PATH_INFO: `/v3/projects/ee0041a1196e4b54b457f1b66d6f721b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:25.944617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0041a1196e4b54b457f1b66d6f721b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:25.947397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:25.969094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:26.001459 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0041a1196e4b54b457f1b66d6f721b', 'request_id': 'req-542e41e0-e452-4255-9896-3b33650c96fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:26.011872 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0041a1196e4b54b457f1b66d6f721b', 'request_id': 'req-542e41e0-e452-4255-9896-3b33650c96fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:26.018934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0041a1196e4b54b457f1b66d6f721b', 'request_id': 'req-542e41e0-e452-4255-9896-3b33650c96fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:26.033015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] The token cache is being invalidate because project ee0041a1196e4b54b457f1b66d6f721b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:26.033351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:26.034089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-542e41e0-e452-4255-9896-3b33650c96fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:26.035774 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1266/2544] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:25 2022] DELETE /identity/v3/projects/ee0041a1196e4b54b457f1b66d6f721b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:26.041181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.041479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.041757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.061902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:26.063131 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:26.129310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1279/2545] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:26.144255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.144555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.144834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.166878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:26.168111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:26.177611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1267/2546] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:26.182193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.193416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e804e85-1473-4dfe-9e27-cda6861a2f7f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.199279 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.199950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.200249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.200560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.201332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:26.201639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.203264 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.216192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1280/2547] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:25:26.220795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.230556 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4189b9-3333-4bb6-b9d2-ed03cf0b875f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.236458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.237148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.237446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.237722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.238428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.240346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.271893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1268/2548] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:26 2022] POST /identity/v3/projects => generated 376 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:26.276328 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.286873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474bc5-8123-44d5-810e-5ece61c907cb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.328242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:26.352737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.353467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.353740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.354025 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.354727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.357015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.380081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1281/2549] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:26 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:26.386020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.399911 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27d90-6f71-4a3c-b78c-e97a5f776801 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.405595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.406291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.406580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.406858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.407638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.409329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.420818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1269/2550] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:26 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:26.425029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.436062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af860a7a-408b-43dd-8221-55189279d7df admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.441169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ecff6-6e83-4520-ba34-6b863eb85e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.441867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ecff6-6e83-4520-ba34-6b863eb85e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.442151 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ecff6-6e83-4520-ba34-6b863eb85e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.442426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ecff6-6e83-4520-ba34-6b863eb85e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.443229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ecff6-6e83-4520-ba34-6b863eb85e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.444896 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ecff6-6e83-4520-ba34-6b863eb85e9c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.456770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1282/2551] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:26 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:26.461171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.472560 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bffc8-a3f1-4475-b91c-9ede08ceaaae admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.477919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.478820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.479106 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.479384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] PATH_INFO: `/v3/projects/4557db7caca247dcb4a7b30e935e707d/users/aca2dbe52bf64da5b7a55459ea6a6ddf/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.497468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4557db7caca247dcb4a7b30e935e707d, user_id=aca2dbe52bf64da5b7a55459ea6a6ddf, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.500198 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.515391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1270/2552] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:26 2022] PUT /identity/v3/projects/4557db7caca247dcb4a7b30e935e707d/users/aca2dbe52bf64da5b7a55459ea6a6ddf/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:26.525865 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.526170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.526455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.555991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] MFA Rules not processed for user `aca2dbe52bf64da5b7a55459ea6a6ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:26.557587 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:26.631788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1283/2553] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:26.643710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:26.645811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:26.724989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f7e7-43b4-4dfd-b1a9-2d0b4a8a512f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:26.731925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba75a88-6efb-4b26-9083-4c73370015af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:26.732587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75a88-6efb-4b26-9083-4c73370015af service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:26.732873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75a88-6efb-4b26-9083-4c73370015af service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:26.733180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75a88-6efb-4b26-9083-4c73370015af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:26.741464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75a88-6efb-4b26-9083-4c73370015af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:26.743073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75a88-6efb-4b26-9083-4c73370015af service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:26.752462 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1271/2554] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:26.978425 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:27.045961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2d584-6f14-4d57-8a53-c49d970cec8c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:27.051819 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:27.052701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.052982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.053287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] PATH_INFO: `/v3/users/aca2dbe52bf64da5b7a55459ea6a6ddf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.054551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca2dbe52bf64da5b7a55459ea6a6ddf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:27.056488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:27.108746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca2dbe52bf64da5b7a55459ea6a6ddf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.110654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:27.123607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca2dbe52bf64da5b7a55459ea6a6ddf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.124554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca2dbe52bf64da5b7a55459ea6a6ddf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.133456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca2dbe52bf64da5b7a55459ea6a6ddf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.134078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca2dbe52bf64da5b7a55459ea6a6ddf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.146605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1284/2555] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:26 2022] DELETE /identity/v3/users/aca2dbe52bf64da5b7a55459ea6a6ddf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:27.151065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.151550 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.152055 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.172967 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:27.174250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:27.198525 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:27.243299 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1272/2556] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:27.254041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:27.256254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:27.328914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff71a5e-c1db-4d60-97fa-7fc7ed599096 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:27.333110 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aceea0-6a58-4896-94f4-ee473833b153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:27.333796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aceea0-6a58-4896-94f4-ee473833b153 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.334112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aceea0-6a58-4896-94f4-ee473833b153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.334390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aceea0-6a58-4896-94f4-ee473833b153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.344385 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aceea0-6a58-4896-94f4-ee473833b153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:27.345899 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aceea0-6a58-4896-94f4-ee473833b153 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:27.356313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1285/2557] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:27.648635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:27.650267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:27.665399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45c721-b1a5-4261-a7b5-9e98fb561677 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:27.671179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:27.672006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.672283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.672558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] PATH_INFO: `/v3/projects/4557db7caca247dcb4a7b30e935e707d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.673785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4557db7caca247dcb4a7b30e935e707d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:27.675712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:27.729036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4557db7caca247dcb4a7b30e935e707d', 'request_id': 'req-d4560a48-364e-4937-9b82-4b15cf39f26b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.737957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4557db7caca247dcb4a7b30e935e707d', 'request_id': 'req-d4560a48-364e-4937-9b82-4b15cf39f26b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.743937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4557db7caca247dcb4a7b30e935e707d', 'request_id': 'req-d4560a48-364e-4937-9b82-4b15cf39f26b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.755111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] The token cache is being invalidate because project 4557db7caca247dcb4a7b30e935e707d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:27.755402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.756063 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4560a48-364e-4937-9b82-4b15cf39f26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:27.757928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1273/2558] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:27 2022] DELETE /identity/v3/projects/4557db7caca247dcb4a7b30e935e707d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:27.762734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.763055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.763402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.786465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:27.787715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:27.852165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1286/2559] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:27.867412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.867676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.867963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.894630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:27.895866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:27.904750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1274/2560] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:27.909227 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:27.919292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4c652-82a6-4b9c-a53b-5778fb3068dd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:27.924240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:27.924880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.925209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.925518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.926249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:27.926617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:27.928261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:27.940892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1287/2561] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:25:27.945494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:27.955692 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15896001-84b9-4083-8ae7-d707823888c3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:27.961621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:27.962289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:27.962563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:27.962843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:27.963539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:27.966191 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:27.999107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1275/2562] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:27 2022] POST /identity/v3/projects => generated 380 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:28.000883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.011715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3efe0b-01db-47da-a01f-927ea20308ed admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.067949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:28.075501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.076365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.077004 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.077433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.078244 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.081026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.106419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1288/2563] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:27 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:28.110755 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.121512 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258e0e0-a77d-4814-ad46-e256d87b5b44 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.127227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.127878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.128194 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.128470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.129246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.130856 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.143421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1276/2564] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:28 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:28.147747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.161554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494235-fb07-4b8a-8e61-eac1ac190c61 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.168721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c532e-4c74-4bc7-9d86-2715a6fe8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.169440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c532e-4c74-4bc7-9d86-2715a6fe8d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.169759 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c532e-4c74-4bc7-9d86-2715a6fe8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.170068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c532e-4c74-4bc7-9d86-2715a6fe8d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.170823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c532e-4c74-4bc7-9d86-2715a6fe8d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.172496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c532e-4c74-4bc7-9d86-2715a6fe8d52 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.184358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1289/2565] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:28 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:28.188619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.199315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdfc99-f9bd-489f-9d77-a3bdaf4d5839 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.205595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.206103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.206387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.206667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] PATH_INFO: `/v3/projects/5c0e9d58aaa34162a9eeb5da1d3ed598/users/787b776c61eb403c95b136b50666843a/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.223010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0e9d58aaa34162a9eeb5da1d3ed598, user_id=787b776c61eb403c95b136b50666843a, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.225951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.242666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1277/2566] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:28 2022] PUT /identity/v3/projects/5c0e9d58aaa34162a9eeb5da1d3ed598/users/787b776c61eb403c95b136b50666843a/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:28.256555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.256910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.257223 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.286684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] MFA Rules not processed for user `787b776c61eb403c95b136b50666843a`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:28.287914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:28.357642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1290/2567] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:28.362368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.418159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:28.434938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79109f-f6fa-4978-84dc-99111b8b24d4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.439962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.440635 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.440927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.441246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.441948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.443890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.477787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1278/2568] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:28 2022] POST /identity/v3/projects => generated 382 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:28.483390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.494611 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877004d1-69f5-4add-b6e9-0639c0a4c3d0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.554338 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.555032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.555319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.556006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.557867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.559852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.586075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1291/2569] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:28 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:28.592679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.608553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93581a-89d7-485b-a672-9cea33f4cb3e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.614091 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.614806 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.615068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.615385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.616128 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.617832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.630826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1279/2570] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:28 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:28.637088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.648467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8e1fb-b91f-4014-9c9e-a5b320b208ef admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.654862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.655795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.656098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.656399 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] PATH_INFO: `/v3/projects/f882b7ce7a694acd9e3594c94f0c3242/users/e6edec2f14804faab1fbb208f6fddb00/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.675391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f882b7ce7a694acd9e3594c94f0c3242, user_id=e6edec2f14804faab1fbb208f6fddb00, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.679831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.698682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1292/2571] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:28 2022] PUT /identity/v3/projects/f882b7ce7a694acd9e3594c94f0c3242/users/e6edec2f14804faab1fbb208f6fddb00/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:28.702886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.713984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e97e-adbb-4595-9eba-5b23caa09846 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.776267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61626-8a0b-4459-b82e-8782554f6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.777179 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61626-8a0b-4459-b82e-8782554f6629 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.777366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61626-8a0b-4459-b82e-8782554f6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.777537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61626-8a0b-4459-b82e-8782554f6629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.778304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef61626-8a0b-4459-b82e-8782554f6629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.779898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef61626-8a0b-4459-b82e-8782554f6629 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.790762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1280/2572] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:28 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:28.795509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.807164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d218-9bab-4df1-a506-3b02c568efbf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.813339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.814310 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.814521 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.814792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] PATH_INFO: `/v3/projects/f882b7ce7a694acd9e3594c94f0c3242/users/e6edec2f14804faab1fbb208f6fddb00/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.816895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f882b7ce7a694acd9e3594c94f0c3242, user_id=e6edec2f14804faab1fbb208f6fddb00, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.819649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.832570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1293/2573] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:28 2022] PUT /identity/v3/projects/f882b7ce7a694acd9e3594c94f0c3242/users/e6edec2f14804faab1fbb208f6fddb00/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:28.844391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.844738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.845236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.878274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] MFA Rules not processed for user `e6edec2f14804faab1fbb208f6fddb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:28.879491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:28.957216 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1281/2574] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:28.970026 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.971831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:28.997825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:29.040451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ede5c9-cbf9-43f5-b16c-91c7dd528a1b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:29.044767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:29.045462 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:29.045744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:29.046023 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:29.056083 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:29.057617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:29.067449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1294/2575] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:29.156776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:29.167197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a7db4-ecec-4835-836a-6faf3614b7f1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:29.171957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:29.172600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:29.172885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:29.173156 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:29.221064 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:29.239446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:29.240935 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:29.250676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1282/2576] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:36.000798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.002600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.076049 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8a106-5d6d-411e-af4e-b59b2863e327 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:36.081464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:36.082369 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.082651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.082960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] PATH_INFO: `/v3/users/7ad7c43573de457e9e1ec4551f670b6d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.084218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad7c43573de457e9e1ec4551f670b6d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:36.086212 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:36.138168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad7c43573de457e9e1ec4551f670b6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.154334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad7c43573de457e9e1ec4551f670b6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.155068 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad7c43573de457e9e1ec4551f670b6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.163168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad7c43573de457e9e1ec4551f670b6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.163833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-21a35c64-34c0-4963-8ab0-165822688413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad7c43573de457e9e1ec4551f670b6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.164434 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.175996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328a916-8636-4686-ac79-ad69207f0a23 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:36.177076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1295/2577] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:35 2022] DELETE /identity/v3/users/7ad7c43573de457e9e1ec4551f670b6d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:36.181617 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140709c-838d-4525-8537-d34294bdc05c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.181910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140709c-838d-4525-8537-d34294bdc05c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.182193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140709c-838d-4525-8537-d34294bdc05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.203684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9140709c-838d-4525-8537-d34294bdc05c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:36.204852 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9140709c-838d-4525-8537-d34294bdc05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.238468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:36.239080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:36.239575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.239710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.239989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] PATH_INFO: `/v3/users/787b776c61eb403c95b136b50666843a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.241492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787b776c61eb403c95b136b50666843a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:36.243565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:36.270490 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1296/2578] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:36.281474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140709c-838d-4525-8537-d34294bdc05c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.282970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9140709c-838d-4525-8537-d34294bdc05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.293804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787b776c61eb403c95b136b50666843a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.294486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787b776c61eb403c95b136b50666843a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.295158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787b776c61eb403c95b136b50666843a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.308502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787b776c61eb403c95b136b50666843a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.317244 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bbe56403-a8a5-4946-829c-679622daa114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787b776c61eb403c95b136b50666843a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.330835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1283/2579] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:36 2022] DELETE /identity/v3/users/787b776c61eb403c95b136b50666843a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:36.336155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.336667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.336956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.352215 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140709c-838d-4525-8537-d34294bdc05c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:36.360002 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:36.361283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.406064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:36.406764 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.407071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.407341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.409153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.433973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:36.445439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1284/2580] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:36.455084 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.456485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.468691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f98ca-eab6-4c08-a68f-63f8c6066268 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:36.472497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:36.473427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.473780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.474127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.476459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:36.477873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:36.483722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:36.485182 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:36.487566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1297/2581] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:36.495223 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1285/2582] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:25:36.847008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.848631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.860403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.861950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:36.865965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e4042-7785-4de8-b19f-8fa478c145b2 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:36.877773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:36.878845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.879216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.879588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] PATH_INFO: `/v3/projects/0c8070fbc65b477bb734cf568019bbe2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.880917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c841f-1e6d-4d3b-918d-95589d53b6b0 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:36.881334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8070fbc65b477bb734cf568019bbe2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:36.883512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:36.890507 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:36.893848 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.894271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.894554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] PATH_INFO: `/v3/projects/5c0e9d58aaa34162a9eeb5da1d3ed598` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.896017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0e9d58aaa34162a9eeb5da1d3ed598)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:36.898630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:36.933206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:36.941834 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8070fbc65b477bb734cf568019bbe2', 'request_id': 'req-2836731c-488a-4d46-982e-313010b53821'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.952122 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8070fbc65b477bb734cf568019bbe2', 'request_id': 'req-2836731c-488a-4d46-982e-313010b53821'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.952665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0e9d58aaa34162a9eeb5da1d3ed598', 'request_id': 'req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.959087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8070fbc65b477bb734cf568019bbe2', 'request_id': 'req-2836731c-488a-4d46-982e-313010b53821'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.960709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0e9d58aaa34162a9eeb5da1d3ed598', 'request_id': 'req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.966591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0e9d58aaa34162a9eeb5da1d3ed598', 'request_id': 'req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.971368 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] The token cache is being invalidate because project 0c8070fbc65b477bb734cf568019bbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:36.971668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.972412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2836731c-488a-4d46-982e-313010b53821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.974750 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1298/2583] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:36 2022] DELETE /identity/v3/projects/0c8070fbc65b477bb734cf568019bbe2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:36.978199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] The token cache is being invalidate because project 5c0e9d58aaa34162a9eeb5da1d3ed598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:36.978199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.978707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:36.979681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c63737-f7c3-4c22-8e13-393f01e2c0ba None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:36.979978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c63737-f7c3-4c22-8e13-393f01e2c0ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:36.980220 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1286/2584] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:36 2022] DELETE /identity/v3/projects/5c0e9d58aaa34162a9eeb5da1d3ed598 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:36.980335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c63737-f7c3-4c22-8e13-393f01e2c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:36.984228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:36.985683 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.001040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-52c63737-f7c3-4c22-8e13-393f01e2c0ba None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:37.002280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-52c63737-f7c3-4c22-8e13-393f01e2c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.050083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622cd7-d0dd-4f62-ba33-764760ba4b3c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.054754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.055640 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.055922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.056196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] PATH_INFO: `/v3/users/e6edec2f14804faab1fbb208f6fddb00` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.057441 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6edec2f14804faab1fbb208f6fddb00)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.059443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.062995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1299/2585] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:37.070785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.071074 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.071348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.092373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:37.093629 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.102879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1300/2586] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:37.107509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6edec2f14804faab1fbb208f6fddb00'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.107677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.108205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6edec2f14804faab1fbb208f6fddb00'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.108824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6edec2f14804faab1fbb208f6fddb00'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.117407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3483-0aea-4027-9119-93e36bec37a3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.122230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6edec2f14804faab1fbb208f6fddb00'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.122395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.122889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.123173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.123453 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.124259 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:37.124566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.126210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.130448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6edec2f14804faab1fbb208f6fddb00'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.131690 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:37.138992 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1301/2587] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:25:37.143530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.144700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1287/2588] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:36 2022] DELETE /identity/v3/users/e6edec2f14804faab1fbb208f6fddb00 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:37.148261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.161417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09309-4ccd-43a9-9aa0-2c6f16306a63 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.222242 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.222821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.223103 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.223376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.224073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.226020 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.254677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1302/2589] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/projects => generated 358 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:37.258745 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.269800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f37804-3c0f-4e66-9178-d5cd48167651 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.334843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.335540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.335823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.336105 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.336818 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.339165 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.365726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1288/2590] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:37.367214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.378144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf661-938e-4392-a9d5-422ee0b68070 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.383443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.384140 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.384431 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.384776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.385554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.387569 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.402434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1303/2591] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:37.406681 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.417414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d66f-0740-4580-975e-27e37074f131 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.419707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.422671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.423275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.423432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.423562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.423847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.424600 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.426306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.442209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1289/2592] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:37.442530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d7d2-bb28-40f3-a73b-c1e4fa45176f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.447271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.448143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.448421 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.448692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] PATH_INFO: `/v3/projects/f882b7ce7a694acd9e3594c94f0c3242` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.450332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f882b7ce7a694acd9e3594c94f0c3242)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.450499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.452292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.471771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7f3e-d834-4b43-a9d4-d18de8a1364a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.476817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4229f0-df21-4c8f-8637-32e50bf6a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.477841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4229f0-df21-4c8f-8637-32e50bf6a852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.478184 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4229f0-df21-4c8f-8637-32e50bf6a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.478519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4229f0-df21-4c8f-8637-32e50bf6a852 admin admin] PATH_INFO: `/v3/projects/ef203308b1ce44b3bda3b988c639d6b6/users/cad5e8d5fd5a44c2b3cf33a83f493069/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.479738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:37.494619 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4229f0-df21-4c8f-8637-32e50bf6a852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef203308b1ce44b3bda3b988c639d6b6, user_id=cad5e8d5fd5a44c2b3cf33a83f493069, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.497386 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4229f0-df21-4c8f-8637-32e50bf6a852 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.510108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f882b7ce7a694acd9e3594c94f0c3242', 'request_id': 'req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.510849 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1290/2593] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:37 2022] PUT /identity/v3/projects/ef203308b1ce44b3bda3b988c639d6b6/users/cad5e8d5fd5a44c2b3cf33a83f493069/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:37.522633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f882b7ce7a694acd9e3594c94f0c3242', 'request_id': 'req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.522830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41181cd-9618-4db1-a131-78078da634eb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.523099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41181cd-9618-4db1-a131-78078da634eb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.523376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41181cd-9618-4db1-a131-78078da634eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.530053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f882b7ce7a694acd9e3594c94f0c3242', 'request_id': 'req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.544037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] The token cache is being invalidate because project f882b7ce7a694acd9e3594c94f0c3242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:37.544327 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.545040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c20a09e1-5b7c-4ac4-a0df-fe9c126c7da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.546704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1304/2594] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:37 2022] DELETE /identity/v3/projects/f882b7ce7a694acd9e3594c94f0c3242 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:37.552404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.552693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.552969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.557018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f41181cd-9618-4db1-a131-78078da634eb None None] MFA Rules not processed for user `cad5e8d5fd5a44c2b3cf33a83f493069`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:37.558260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f41181cd-9618-4db1-a131-78078da634eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.572413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:37.573637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.626576 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1291/2595] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:37.637965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1305/2596] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:37.647114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.647455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.647752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.663618 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.665294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.670187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:37.671374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.679914 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1292/2597] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:37.684280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.693360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac658-7111-452f-b6bf-083d55dda2f2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.698372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.699015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.699356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.699639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.700497 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:37.700798 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.702437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.714653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1293/2598] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:25:37.719083 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.728254 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb77d-53d3-46eb-bd51-c17f36839784 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.728468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcca94-7237-4cb1-86b3-779cc39d2cfb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.732118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.732781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.733064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.733371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.733500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.734145 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.734426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.734700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.735396 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.737325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.742243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.743692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.749236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:37.754003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1306/2599] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:37.771896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1294/2600] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/projects => generated 384 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:37.773612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.774308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.775892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.792467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217590ce-109e-40ef-9a25-465b023612d9 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.845599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:37.845976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb296f7-f624-4270-91d9-295366e5aee4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.851820 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.852615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.853158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.853342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.854170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.856407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.864122 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.865894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.866255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.866603 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] PATH_INFO: `/v3/users/cad5e8d5fd5a44c2b3cf33a83f493069` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.869091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad5e8d5fd5a44c2b3cf33a83f493069)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.871908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.882575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1295/2601] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:37.886796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.900767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc89402-7433-40b6-be8a-40e10286a164 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.907228 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.908046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.909011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.909011 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.909602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.911402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.925394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1296/2602] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:25:37.929549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.932192 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad5e8d5fd5a44c2b3cf33a83f493069'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.941457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08aab-40f7-47ec-a7d5-a64b7a32c513 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:37.946711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:37.947405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.947631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad5e8d5fd5a44c2b3cf33a83f493069'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.947740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.947960 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.948600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad5e8d5fd5a44c2b3cf33a83f493069'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.948707 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:37.950547 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:37.961271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad5e8d5fd5a44c2b3cf33a83f493069'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.962353 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-19cbe8e2-412d-481d-95ab-1d9e69f21b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad5e8d5fd5a44c2b3cf33a83f493069'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:37.965772 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1297/2603] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:37 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:37.969986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:37.971939 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:37.979650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1307/2604] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:37 2022] DELETE /identity/v3/users/cad5e8d5fd5a44c2b3cf33a83f493069 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:37.984628 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:37.984923 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:37.985238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:37.987519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359cb05-7c89-489c-91fc-3fc1afb697da admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.004666 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:38.005966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.044838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46f37c-7dac-4b7c-a83a-6174ad2ee798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.045767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46f37c-7dac-4b7c-a83a-6174ad2ee798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.046048 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46f37c-7dac-4b7c-a83a-6174ad2ee798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.046371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46f37c-7dac-4b7c-a83a-6174ad2ee798 admin admin] PATH_INFO: `/v3/projects/bf32ad63773d4d2ca6c377d843bed5be/users/6668e41abe514b9c96ea1a4ae5a9a6f2/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.061360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46f37c-7dac-4b7c-a83a-6174ad2ee798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf32ad63773d4d2ca6c377d843bed5be, user_id=6668e41abe514b9c96ea1a4ae5a9a6f2, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.064012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46f37c-7dac-4b7c-a83a-6174ad2ee798 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.068366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1308/2605] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:38.077516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1298/2606] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:37 2022] PUT /identity/v3/projects/bf32ad63773d4d2ca6c377d843bed5be/users/6668e41abe514b9c96ea1a4ae5a9a6f2/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:38.079163 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.080658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.089157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.089466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.089749 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.120060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] MFA Rules not processed for user `6668e41abe514b9c96ea1a4ae5a9a6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:38.121426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.142945 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fcfec-b66d-4b0d-9fd7-2366958177bc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.152633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:38.168916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:38.190920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1299/2607] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:38.197319 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.198063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.198363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.198766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.203915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.205465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.262912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.264321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ea62-b531-49e4-9420-922ec33e66fb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.264789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.268006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974626b-dea7-4f13-9c09-c43859d8b728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.268662 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974626b-dea7-4f13-9c09-c43859d8b728 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.268948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974626b-dea7-4f13-9c09-c43859d8b728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.269258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974626b-dea7-4f13-9c09-c43859d8b728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.274828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1309/2608] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:38.278319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974626b-dea7-4f13-9c09-c43859d8b728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.279775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974626b-dea7-4f13-9c09-c43859d8b728 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.289073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1300/2609] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:38.307842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.317837 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e159e-4c1a-491c-9dfd-564932384d87 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.322636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.323525 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.323804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.324168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] PATH_INFO: `/v3/users/6668e41abe514b9c96ea1a4ae5a9a6f2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.325864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6668e41abe514b9c96ea1a4ae5a9a6f2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.327930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.384495 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6668e41abe514b9c96ea1a4ae5a9a6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.399744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6668e41abe514b9c96ea1a4ae5a9a6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.400682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6668e41abe514b9c96ea1a4ae5a9a6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.410012 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6668e41abe514b9c96ea1a4ae5a9a6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.410663 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6668e41abe514b9c96ea1a4ae5a9a6f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.427707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1310/2610] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:38 2022] DELETE /identity/v3/users/6668e41abe514b9c96ea1a4ae5a9a6f2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:38.432323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.432733 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.433170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.454866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:38.456121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.524518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1301/2611] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:38.534506 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.535918 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.576221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.578030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.594676 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b66f8-8680-4bae-b07d-fd36cd5f476e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.598463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:38.602931 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.603616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58bc8e-e4d9-45cf-a224-d4fc7f734892 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.603811 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.604126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.604414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] PATH_INFO: `/v3/projects/ef203308b1ce44b3bda3b988c639d6b6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.605723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef203308b1ce44b3bda3b988c639d6b6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.607802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.608709 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa749-bc93-4327-a87d-98671f8c7801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.609674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa749-bc93-4327-a87d-98671f8c7801 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.610359 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa749-bc93-4327-a87d-98671f8c7801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.610640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa749-bc93-4327-a87d-98671f8c7801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.621232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaa749-bc93-4327-a87d-98671f8c7801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.622990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaa749-bc93-4327-a87d-98671f8c7801 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.634135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1311/2612] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:38.656657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef203308b1ce44b3bda3b988c639d6b6', 'request_id': 'req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.665188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef203308b1ce44b3bda3b988c639d6b6', 'request_id': 'req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.671253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef203308b1ce44b3bda3b988c639d6b6', 'request_id': 'req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.679379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:38.684162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] The token cache is being invalidate because project ef203308b1ce44b3bda3b988c639d6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:38.684876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.685606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8dab07e5-21b6-48c0-aac9-f8d242d8bcf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:38.687325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1302/2613] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:38 2022] DELETE /identity/v3/projects/ef203308b1ce44b3bda3b988c639d6b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:38.692824 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.693077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.693408 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.714805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:38.716251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.781248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1312/2614] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:38.786866 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.787164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.787447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.810494 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:38.811742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.820969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1303/2615] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:38.825711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.837371 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a24a1-cd4e-4298-b43b-bbf4c1d97b1a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.842478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.843158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.843444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.843722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.844580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:38.844891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.846561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.859502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1313/2616] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:25:38.863922 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.873524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e820e-1d8e-4f55-832b-66c8c2d9c8d5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.878509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.879175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.879467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.879745 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.880438 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.882421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.913977 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.916275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:38.917819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1304/2617] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:38 2022] POST /identity/v3/projects => generated 386 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:38.918734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:38.931816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63805a47-7158-4daf-aa86-0393205e5205 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.987980 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86a14-2587-437c-9031-6934afd90441 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:38.992734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.993447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.993730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.994035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.994732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:38.994857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:38.995636 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:38.995915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:38.996502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] PATH_INFO: `/v3/projects/bf32ad63773d4d2ca6c377d843bed5be` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:38.996687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:38.998168 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf32ad63773d4d2ca6c377d843bed5be)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.000069 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.022433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1305/2618] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:38 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:39.023499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.035706 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92548e-19d8-409d-9fdd-271e7a9ed148 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.050576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf32ad63773d4d2ca6c377d843bed5be', 'request_id': 'req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:39.060337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf32ad63773d4d2ca6c377d843bed5be', 'request_id': 'req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:39.066386 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf32ad63773d4d2ca6c377d843bed5be', 'request_id': 'req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:39.079457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] The token cache is being invalidate because project bf32ad63773d4d2ca6c377d843bed5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:39.079752 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:39.080435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e5b49c9-d91a-4e68-aa82-8a053056dcfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:39.082302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1314/2619] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:38 2022] DELETE /identity/v3/projects/bf32ad63773d4d2ca6c377d843bed5be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:39.087229 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43170-138e-4c87-8e58-85e50d142a39 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.087530 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43170-138e-4c87-8e58-85e50d142a39 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.087851 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43170-138e-4c87-8e58-85e50d142a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.098092 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.098786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.099073 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.099354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.100095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.101752 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.107304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2ad43170-138e-4c87-8e58-85e50d142a39 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:39.108550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2ad43170-138e-4c87-8e58-85e50d142a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.111854 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1306/2620] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:39.115860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.116948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1315/2621] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:39.121751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.125060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.125422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.125710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.134427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af1cc-0057-4c53-90d1-b62f1c96216e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.135384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:39.139893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.140565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.140852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.141164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.141891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.143498 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.149314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:39.150643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.157288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1307/2622] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:25:39.158504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.159220 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1316/2623] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:39.163095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.169041 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb23e-4d5d-4703-907e-9e91a30db6c5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.172197 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60a319-3227-4f43-b778-498f8d44e369 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.173666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7fca0-08b2-40e0-99ee-5663a85f061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.174557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fca0-08b2-40e0-99ee-5663a85f061e admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.174850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fca0-08b2-40e0-99ee-5663a85f061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.175133 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fca0-08b2-40e0-99ee-5663a85f061e admin admin] PATH_INFO: `/v3/projects/1a8a0654c8c2402cbfced45dc5e8fcf4/users/87cb9e85bf1649b495dc5b188908afb1/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.176915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.177594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.177870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.178145 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.178893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:39.179195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.180786 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.190589 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7fca0-08b2-40e0-99ee-5663a85f061e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8a0654c8c2402cbfced45dc5e8fcf4, user_id=87cb9e85bf1649b495dc5b188908afb1, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.192664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1317/2624] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:25:39.193567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7fca0-08b2-40e0-99ee-5663a85f061e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.196909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.208520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5e2c-4f3d-47a5-975a-01355a3d2043 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.208743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1308/2625] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:39 2022] PUT /identity/v3/projects/1a8a0654c8c2402cbfced45dc5e8fcf4/users/87cb9e85bf1649b495dc5b188908afb1/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:39.220373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.220665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.221138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.249754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] MFA Rules not processed for user `87cb9e85bf1649b495dc5b188908afb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:39.251004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.259312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:39.276029 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.276695 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.276976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.277278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.278205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.280150 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.308395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1318/2626] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/projects => generated 372 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:39.313610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.321233 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1309/2627] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:39.326018 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.340164 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46d6f-94c4-49b1-abcf-70f85ff0ea75 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.386267 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e64d0-3112-4b15-a604-4268a19b7829 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.393560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.394255 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.394551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.395187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.395901 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.398269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.412574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.413395 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.413770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.414053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.414779 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.416698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.425108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1319/2628] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:39.426209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.436248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f0d5-fb27-4546-ad59-b485d44e2607 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.441696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.442372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.442656 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.442931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.443664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.447899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1310/2629] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/projects => generated 386 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:39.448062 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.449456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.461146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1320/2630] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:39.462079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.473105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1c2a-97dc-4c0e-b884-c095ead0a522 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.515116 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1052-2e1e-4213-b371-3a53f3dce82d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.519424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:39.519878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.520549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.520847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.521162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.521950 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.523919 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.534121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.534889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.535218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.535614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.536402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.538152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.549039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1311/2631] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:39.549263 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1321/2632] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:39.550277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.552570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.562127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61458c-e6ba-4fb0-9424-9f017c5213c1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.562364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e77109-fb86-49ff-98f1-022ea0187de8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.567526 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b040c4-2c0e-4a37-905a-cab3819e706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.567730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.568413 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.568541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b040c4-2c0e-4a37-905a-cab3819e706b admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.568700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.568803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b040c4-2c0e-4a37-905a-cab3819e706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.568968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.569099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b040c4-2c0e-4a37-905a-cab3819e706b admin admin] PATH_INFO: `/v3/projects/54abcab2b3fe44dca820f04669497a10/users/11a298287d4846d28ddfd68871748db7/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.569780 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.571406 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.582611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1312/2633] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:39.585910 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b040c4-2c0e-4a37-905a-cab3819e706b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54abcab2b3fe44dca820f04669497a10, user_id=11a298287d4846d28ddfd68871748db7, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.586732 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.589346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b040c4-2c0e-4a37-905a-cab3819e706b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.597487 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b05e-14eb-4dfc-8fd8-2ec6681989db admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.602563 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.603235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.603523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.603804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.604558 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.605104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1322/2634] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:39 2022] PUT /identity/v3/projects/54abcab2b3fe44dca820f04669497a10/users/11a298287d4846d28ddfd68871748db7/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:39.606530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.616301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.616588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.616861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.620527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1313/2635] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:39.621504 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.626610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:39.631762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7410-a6af-4a9c-801a-20dce44a0c78 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.646535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] MFA Rules not processed for user `11a298287d4846d28ddfd68871748db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:39.647754 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.690893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895549d-7900-4f4f-9c49-ec91d5d973a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.691825 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895549d-7900-4f4f-9c49-ec91d5d973a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.692109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895549d-7900-4f4f-9c49-ec91d5d973a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.692383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895549d-7900-4f4f-9c49-ec91d5d973a1 admin admin] PATH_INFO: `/v3/projects/3edd70aef4c74f8798c0f53ced84a2bd/users/ddf4ed71ccd4409480d91c788229ebef/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.707527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895549d-7900-4f4f-9c49-ec91d5d973a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edd70aef4c74f8798c0f53ced84a2bd, user_id=ddf4ed71ccd4409480d91c788229ebef, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.710366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895549d-7900-4f4f-9c49-ec91d5d973a1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.714266 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1323/2636] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:39.724659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1314/2637] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:39 2022] PUT /identity/v3/projects/3edd70aef4c74f8798c0f53ced84a2bd/users/ddf4ed71ccd4409480d91c788229ebef/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:39.726024 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.727483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.735753 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.736035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.736313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.764932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] MFA Rules not processed for user `ddf4ed71ccd4409480d91c788229ebef`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:39.766199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:39.785294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b22-99e2-42ab-b8ae-9ac33173867f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.831603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1315/2638] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:39.835126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.835806 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.835970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.836114 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.836424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.853912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:39.895776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.897273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.900785 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592e30-db9c-4874-89ef-24c94fc06af8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.906153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.906830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:39.906972 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1324/2639] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:39.907195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:39.907482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:39.908258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:39.910230 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:39.928794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.935932 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:39.940584 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f565d4-b92b-4d80-8cb8-dc1eb607e6bd service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:39.943508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1316/2640] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/projects => generated 384 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:39.947269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:39.998912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:39.999814 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.000097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.000372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] PATH_INFO: `/v3/users/11a298287d4846d28ddfd68871748db7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.001634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a298287d4846d28ddfd68871748db7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.003635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.011436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517af1c-3491-438a-8dd1-2475334fad37 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.016976 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.017688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.017977 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.018253 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.018957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.020892 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.047339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1317/2641] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:39 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:40.048423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.055893 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a298287d4846d28ddfd68871748db7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.058393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c95823-1de9-41ef-8c8e-6459eb59c89f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.064221 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.064909 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.065264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.065538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.067722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.069661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.070183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a298287d4846d28ddfd68871748db7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.071157 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a298287d4846d28ddfd68871748db7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.080962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a298287d4846d28ddfd68871748db7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.082467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5821b59c-c2c3-4daa-92a0-41de667788c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a298287d4846d28ddfd68871748db7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.082903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1318/2642] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:40 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:40.087750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.089663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.096991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1325/2643] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:39 2022] DELETE /identity/v3/users/11a298287d4846d28ddfd68871748db7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:40.101394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.101688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.101968 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.104737 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05ffd7-d55d-4ced-a567-3a51412a259d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.121459 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:40.122696 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.155767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:40.162622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.163534 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.163821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.164104 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] PATH_INFO: `/v3/projects/4364b7adadec4b7f9cf02310a24862eb/users/64f23fee6d974765acd4f30ade8d57f0/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.178444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4364b7adadec4b7f9cf02310a24862eb, user_id=64f23fee6d974765acd4f30ade8d57f0, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.181193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.187160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1326/2644] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:40.194538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1319/2645] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:40 2022] PUT /identity/v3/projects/4364b7adadec4b7f9cf02310a24862eb/users/64f23fee6d974765acd4f30ade8d57f0/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:40.197474 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.198524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.198958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.257502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256fa8-8e8e-4479-82c6-e55aa41980d9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.264384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362847-9baa-47a9-9b51-d83db33af9d7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.269365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.270051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.270325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.270605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.271343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.272954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.275166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:40.288076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1320/2646] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:40 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:25:40.289162 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.299569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170800-a11c-4dbd-9a40-f7670332f8ab admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.304682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963a35c-6ff3-4135-9d70-bebc4abe29d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.305591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a35c-6ff3-4135-9d70-bebc4abe29d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.305877 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a35c-6ff3-4135-9d70-bebc4abe29d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.306157 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a35c-6ff3-4135-9d70-bebc4abe29d5 admin admin] PATH_INFO: `/v3/projects/4364b7adadec4b7f9cf02310a24862eb/users/64f23fee6d974765acd4f30ade8d57f0/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.308193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963a35c-6ff3-4135-9d70-bebc4abe29d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4364b7adadec4b7f9cf02310a24862eb, user_id=64f23fee6d974765acd4f30ade8d57f0, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.311065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963a35c-6ff3-4135-9d70-bebc4abe29d5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.311803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.312631 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.312951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.313261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.321541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1321/2647] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:40 2022] PUT /identity/v3/projects/4364b7adadec4b7f9cf02310a24862eb/users/64f23fee6d974765acd4f30ade8d57f0/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:25:40.323302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.324835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.332423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.332767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.333006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.335889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1327/2648] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:40.364446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] MFA Rules not processed for user `64f23fee6d974765acd4f30ade8d57f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:40.365764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.446540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1322/2649] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:25:40.460330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.461928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.523955 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726a27-afe8-48cb-9c6e-dec180049d7b service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.576079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.576744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.577031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.577364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.579513 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.585887 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:40.622748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.624893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.645095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.646688 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192da0f-cc75-456c-b2bf-a9032b649325 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.657380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1328/2650] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:40.708099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd3b7-71b8-4405-b874-9fdce9d58267 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.713235 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.714095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.714375 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.714648 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] PATH_INFO: `/v3/projects/54abcab2b3fe44dca820f04669497a10` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.716035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54abcab2b3fe44dca820f04669497a10)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.717986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.767841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54abcab2b3fe44dca820f04669497a10', 'request_id': 'req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.778039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54abcab2b3fe44dca820f04669497a10', 'request_id': 'req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.784472 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54abcab2b3fe44dca820f04669497a10', 'request_id': 'req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.793066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:40.797912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] The token cache is being invalidate because project 54abcab2b3fe44dca820f04669497a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:40.798247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.799126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2b80b7b3-223d-442d-9dd6-7f96e1c2881d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:40.801163 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1323/2651] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:40 2022] DELETE /identity/v3/projects/54abcab2b3fe44dca820f04669497a10 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:40.806593 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.806870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.807156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.829237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:40.830460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.892529 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1329/2652] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:40.900257 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.900537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.900712 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.922489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:40.923843 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:40.933651 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1324/2653] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:40.938160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.948205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732ca0d-1b27-4b76-aff9-e8561a5eb2c5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.954548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.955230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.955510 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.955781 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.956535 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:40.956835 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.958463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:40.974494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1330/2654] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:25:40.979046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:40.989598 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4aa1-e096-4890-9d05-fe48d97da789 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:40.994684 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:40.995424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:40.995777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:40.996122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:40.996896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:40.998945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:41.028580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1325/2655] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:40 2022] POST /identity/v3/projects => generated 384 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:25:41.032881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:41.043486 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd926d9f-ba3c-426c-9120-c48fe9dbd91f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:41.100545 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:41.101237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:41.101420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:41.101726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:41.102402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:41.104325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:41.128892 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1331/2656] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:41 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:41.133280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:41.144344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6666e2-4732-401d-bed8-670eb4212c2e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:41.149995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:41.150655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:41.150993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:41.151267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:41.152169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:41.154122 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:41.164778 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1326/2657] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:41.169485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:41.181330 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14f262-baa7-4372-bd8b-1749677b6146 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:41.186612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6d5db-a5ff-485a-8274-7aa7af9d9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:41.187286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d5db-a5ff-485a-8274-7aa7af9d9482 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:41.187570 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d5db-a5ff-485a-8274-7aa7af9d9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:41.187843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d5db-a5ff-485a-8274-7aa7af9d9482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:41.188577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6d5db-a5ff-485a-8274-7aa7af9d9482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:41.190316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6d5db-a5ff-485a-8274-7aa7af9d9482 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:41.202455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1332/2658] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:41 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:41.207383 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:41.217694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c804ec-e19c-4cc1-ae61-39faa6047350 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:41.223070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:41.223963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:41.224248 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:41.224529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] PATH_INFO: `/v3/projects/f372b02e6e4345069c60f9e072f3f27e/users/2966c9ce7ad74e05b38b0dae3a20ce04/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:41.239776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f372b02e6e4345069c60f9e072f3f27e, user_id=2966c9ce7ad74e05b38b0dae3a20ce04, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:41.242541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:41.257242 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1327/2659] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:41 2022] PUT /identity/v3/projects/f372b02e6e4345069c60f9e072f3f27e/users/2966c9ce7ad74e05b38b0dae3a20ce04/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:41.262654 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ad02-4e0b-4cfb-9ff2-ea28c2937683 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:41.262952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ad02-4e0b-4cfb-9ff2-ea28c2937683 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:41.263240 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93ad02-4e0b-4cfb-9ff2-ea28c2937683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:41.286508 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4a93ad02-4e0b-4cfb-9ff2-ea28c2937683 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:41.287780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4a93ad02-4e0b-4cfb-9ff2-ea28c2937683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:41.296501 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:41.355725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1333/2660] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:41.373630 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:41.375628 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:41.435427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d7d4-320c-4ac7-8b4f-219267c2a84a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:41.439743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:41.440400 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:41.440652 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:41.440968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:41.451213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:41.453819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:41.466773 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1328/2661] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:42.131085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:42.131627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:42.131627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:42.164142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] MFA Rules not processed for user `2966c9ce7ad74e05b38b0dae3a20ce04`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:42.165482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:42.214627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:42.216750 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:42.256582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1334/2662] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:42.270586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:42.272825 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:42.283373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707503db-48e9-4d96-ab3a-f57a7edd32fe service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:42.287169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:42.287830 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:42.288119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:42.288402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:42.289952 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646a4d-9a43-4787-9fa1-9cde312c2515 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:42.290275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:42.301719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:42.302127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:42.302478 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:42.302822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:42.314035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:42.315497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:42.325868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1335/2663] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:25:42.350860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:42.356355 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:42.358468 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76fc20-c8bd-482b-8d00-27445b3b13ec service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:42.368886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1329/2664] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:42.927042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:42.941605 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07fbec-ee87-4afc-b8fe-edfbfa521bf2 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:42.945463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:42.946143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:42.946426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:42.946698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:42.948546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:43.019393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:43.020864 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:43.031278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1336/2665] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:43.718342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:43.718890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:43.718890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:43.739359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] MFA Rules not processed for user `2966c9ce7ad74e05b38b0dae3a20ce04`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:43.740653 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:43.748808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1330/2666] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:43.991870 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:43.993679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:44.007873 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c127-61c3-416b-b514-dba5dedf519d service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:44.013031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:44.013720 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:44.014006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:44.014283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:44.016678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:44.027595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:44.029043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22372ac2-ec3f-4966-93e2-e947390392ed service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:44.038409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1337/2667] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:47.002015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:47.004020 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:47.018399 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b3f16-a764-4672-85fb-a1dd41b8e80b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:47.023634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:47.024508 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:47.024777 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:47.025074 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] PATH_INFO: `/v3/users/87cb9e85bf1649b495dc5b188908afb1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:47.026391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cb9e85bf1649b495dc5b188908afb1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:47.028478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:47.090532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cb9e85bf1649b495dc5b188908afb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.091246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cb9e85bf1649b495dc5b188908afb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.091863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cb9e85bf1649b495dc5b188908afb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.105287 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cb9e85bf1649b495dc5b188908afb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.114443 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cb9e85bf1649b495dc5b188908afb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.127314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1331/2668] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:47 2022] DELETE /identity/v3/users/87cb9e85bf1649b495dc5b188908afb1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:47.131884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:47.132417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:47.132417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:47.154037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:47.155291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:47.161337 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:47.246740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1338/2669] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:47.257710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:47.259094 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:47.318952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfd027-7001-42cd-bb6c-926498fd6a7a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:47.323338 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:47.324369 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:47.324997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:47.325430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:47.335897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:47.337385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:47.347760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1332/2670] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:25:47.739367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:47.741053 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:47.760113 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674787b4-c390-4691-8fd7-151dcd2dd87d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:47.769108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:47.770027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:47.770349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:47.770762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] PATH_INFO: `/v3/projects/1a8a0654c8c2402cbfced45dc5e8fcf4` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:47.772084 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8a0654c8c2402cbfced45dc5e8fcf4)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:47.774427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:47.826683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8a0654c8c2402cbfced45dc5e8fcf4', 'request_id': 'req-f94d2470-2d5a-4194-be61-184ffe667538'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.835858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8a0654c8c2402cbfced45dc5e8fcf4', 'request_id': 'req-f94d2470-2d5a-4194-be61-184ffe667538'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.842883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8a0654c8c2402cbfced45dc5e8fcf4', 'request_id': 'req-f94d2470-2d5a-4194-be61-184ffe667538'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.854275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] The token cache is being invalidate because project 1a8a0654c8c2402cbfced45dc5e8fcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:47.854567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.855313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.857002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1339/2671] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:47 2022] DELETE /identity/v3/projects/1a8a0654c8c2402cbfced45dc5e8fcf4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:47.860986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:47.871376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d4647-669d-4da0-b4a3-4970b7895fec service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:47.930695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:47.931638 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:47.931921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:47.932195 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] PATH_INFO: `/v3/users/ddf4ed71ccd4409480d91c788229ebef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:47.933530 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf4ed71ccd4409480d91c788229ebef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:47.935460 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:47.937862 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:47.990879 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf4ed71ccd4409480d91c788229ebef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.991884 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf4ed71ccd4409480d91c788229ebef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:47.992894 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf4ed71ccd4409480d91c788229ebef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.005821 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf4ed71ccd4409480d91c788229ebef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.015475 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf4ed71ccd4409480d91c788229ebef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.029606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1333/2672] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:47 2022] DELETE /identity/v3/users/ddf4ed71ccd4409480d91c788229ebef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:48.318152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:48.320491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:48.339293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2470-2d5a-4194-be61-184ffe667538 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:48.406037 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:48.406849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:48.407132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:48.407416 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] PATH_INFO: `/v3/projects/3edd70aef4c74f8798c0f53ced84a2bd` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:48.408613 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edd70aef4c74f8798c0f53ced84a2bd)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:48.410622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:48.454450 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:48.465721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edd70aef4c74f8798c0f53ced84a2bd', 'request_id': 'req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.474290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edd70aef4c74f8798c0f53ced84a2bd', 'request_id': 'req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.479959 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edd70aef4c74f8798c0f53ced84a2bd', 'request_id': 'req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.491456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] The token cache is being invalidate because project 3edd70aef4c74f8798c0f53ced84a2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:48.491762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.492460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.494126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1340/2673] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:48 2022] DELETE /identity/v3/projects/3edd70aef4c74f8798c0f53ced84a2bd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:48.498361 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:48.499875 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:48.512974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779cf2d-e8af-42bb-a607-e579292aacb9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:48.585366 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:48.586329 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:48.586513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:48.586786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] PATH_INFO: `/v3/users/64f23fee6d974765acd4f30ade8d57f0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:48.588034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f23fee6d974765acd4f30ade8d57f0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:48.590259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:48.641286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f23fee6d974765acd4f30ade8d57f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.641966 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f23fee6d974765acd4f30ade8d57f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.642646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f23fee6d974765acd4f30ade8d57f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.656741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f23fee6d974765acd4f30ade8d57f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.665429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c2e4ab7a-5b1c-4e3f-8746-29ae00a0f0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f23fee6d974765acd4f30ade8d57f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:48.674205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:48.681731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1334/2674] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:25:48 2022] DELETE /identity/v3/users/64f23fee6d974765acd4f30ade8d57f0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:48.970233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:48.971723 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:48.988200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1826e-2943-41a0-ad75-59e8a9cc5b9d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.066272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.067181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.067464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.067741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] PATH_INFO: `/v3/projects/4364b7adadec4b7f9cf02310a24862eb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.068996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4364b7adadec4b7f9cf02310a24862eb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.070976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.122932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4364b7adadec4b7f9cf02310a24862eb', 'request_id': 'req-71eb40b0-82aa-47f3-9620-e03084b45952'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:49.132393 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4364b7adadec4b7f9cf02310a24862eb', 'request_id': 'req-71eb40b0-82aa-47f3-9620-e03084b45952'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:49.138788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4364b7adadec4b7f9cf02310a24862eb', 'request_id': 'req-71eb40b0-82aa-47f3-9620-e03084b45952'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:49.151511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] The token cache is being invalidate because project 4364b7adadec4b7f9cf02310a24862eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:25:49.151809 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:49.152667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-71eb40b0-82aa-47f3-9620-e03084b45952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:25:49.154973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1341/2675] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:25:48 2022] DELETE /identity/v3/projects/4364b7adadec4b7f9cf02310a24862eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:49.160061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.160554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.160807 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.181143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:49.182403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:49.247306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1335/2676] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:49.261986 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16564682-2167-45b2-bbfe-506668ad939c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.262773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16564682-2167-45b2-bbfe-506668ad939c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.263143 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16564682-2167-45b2-bbfe-506668ad939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.289475 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-16564682-2167-45b2-bbfe-506668ad939c None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:49.290733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-16564682-2167-45b2-bbfe-506668ad939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:49.300080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1342/2677] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:49.305351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.319315 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828b4bc-bd79-4a8a-84e0-bac7ae1a31f7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.326205 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.326868 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.327158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.327437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.328499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:25:49.328817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.330514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.343969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1336/2678] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:25:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:25:49.348463 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16564682-2167-45b2-bbfe-506668ad939c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.358237 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16564682-2167-45b2-bbfe-506668ad939c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.364132 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.364831 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.365130 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.365417 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.366123 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.368032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.399413 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1343/2679] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:25:49 2022] POST /identity/v3/projects => generated 374 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:49.403934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.414586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46fcc-ccdf-4bcd-ad87-082edeaf72b8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.491647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.492583 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.492962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.493387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.494407 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.496955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.522629 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1337/2680] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:25:49 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:25:49.526826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.537690 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870641ce-91f3-4b94-a22b-490559201f88 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.543248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.543916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.544252 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.544533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.545295 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.546898 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.557544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1344/2681] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:49 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:49.561674 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.572131 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130875d3-ad8e-4f19-97ee-8c42a52c65fd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.577319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48567e1-3554-4325-be33-e630c7e81f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.578339 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48567e1-3554-4325-be33-e630c7e81f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.578632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48567e1-3554-4325-be33-e630c7e81f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.578917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48567e1-3554-4325-be33-e630c7e81f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.579682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48567e1-3554-4325-be33-e630c7e81f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.581362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48567e1-3554-4325-be33-e630c7e81f0f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.592424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1338/2682] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:25:49 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:25:49.596748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.607447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ed151-1b50-402f-9e88-0a45e50723b6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.612576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.613498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.613782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.614052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] PATH_INFO: `/v3/projects/4d24ee3ed9934cebb829c3945de56e4e/users/7e9ea61b8bc94d4e8706b93499fe9b81/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.627619 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:49.632136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d24ee3ed9934cebb829c3945de56e4e, user_id=7e9ea61b8bc94d4e8706b93499fe9b81, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.635928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.652990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1345/2683] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:25:49 2022] PUT /identity/v3/projects/4d24ee3ed9934cebb829c3945de56e4e/users/7e9ea61b8bc94d4e8706b93499fe9b81/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:25:49.658466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c72c8-f1c4-442f-baa0-7293e6f2021a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.658770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c72c8-f1c4-442f-baa0-7293e6f2021a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.659068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c72c8-f1c4-442f-baa0-7293e6f2021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.679237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-624c72c8-f1c4-442f-baa0-7293e6f2021a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:49.680455 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-624c72c8-f1c4-442f-baa0-7293e6f2021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:49.745437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1339/2684] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:49.757494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:49.761183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:49.836154 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d559-7ecf-4bbd-88b4-6d44bd2a95d0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:49.841040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:49.841728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:49.842008 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:49.842280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:49.852188 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:49.853727 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:49.864090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1346/2685] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:50.624758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dfeb2-e716-47bd-a54e-fcc9cf6794cb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:50.625325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dfeb2-e716-47bd-a54e-fcc9cf6794cb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:50.625425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dfeb2-e716-47bd-a54e-fcc9cf6794cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:50.640076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:50.656837 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-828dfeb2-e716-47bd-a54e-fcc9cf6794cb None None] MFA Rules not processed for user `7e9ea61b8bc94d4e8706b93499fe9b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:50.658185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-828dfeb2-e716-47bd-a54e-fcc9cf6794cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:50.726328 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1340/2686] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:25:50.738426 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:50.739917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:50.806180 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0620-d565-4727-a12a-a4adbfadf510 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:50.810464 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc74ac-efa6-42dd-8bc8-a22cdde5be8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:50.811178 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc74ac-efa6-42dd-8bc8-a22cdde5be8e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:50.811458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc74ac-efa6-42dd-8bc8-a22cdde5be8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:50.811733 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc74ac-efa6-42dd-8bc8-a22cdde5be8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:50.820990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc74ac-efa6-42dd-8bc8-a22cdde5be8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:50.822622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc74ac-efa6-42dd-8bc8-a22cdde5be8e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:50.833152 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1347/2687] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:25:52.215466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fb29-d6b9-4b4d-a2a1-e4a1ab21ca08 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:52.216119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fb29-d6b9-4b4d-a2a1-e4a1ab21ca08 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:52.216119 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fb29-d6b9-4b4d-a2a1-e4a1ab21ca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:52.237489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-73b5fb29-d6b9-4b4d-a2a1-e4a1ab21ca08 None None] MFA Rules not processed for user `7e9ea61b8bc94d4e8706b93499fe9b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:25:52.238746 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73b5fb29-d6b9-4b4d-a2a1-e4a1ab21ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:25:52.247025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1341/2688] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:00.828961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:02.232401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=32 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:11.119016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:11.119614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:11.119614 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:11.141144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] MFA Rules not processed for user `7e9ea61b8bc94d4e8706b93499fe9b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:11.142373 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:11.149438 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1348/2689] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:13.744129 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc7da-2387-4041-b74d-380bf60521d2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:13.744833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc7da-2387-4041-b74d-380bf60521d2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:13.744833 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc7da-2387-4041-b74d-380bf60521d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:13.766995 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8acbc7da-2387-4041-b74d-380bf60521d2 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:13.768557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8acbc7da-2387-4041-b74d-380bf60521d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:13.778636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1342/2690] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:13.793546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:13.795063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:13.872861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7317-0275-4697-9db7-1d162393fad9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:13.879077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:13.879906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:13.880249 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:13.880492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:13.889740 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:13.891487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:13.901784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1349/2691] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:16.760384 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93adf9a-4cc0-4bfa-80f2-826f3f39139f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:16.760923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93adf9a-4cc0-4bfa-80f2-826f3f39139f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:16.761009 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93adf9a-4cc0-4bfa-80f2-826f3f39139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:16.782557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e93adf9a-4cc0-4bfa-80f2-826f3f39139f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:16.783898 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e93adf9a-4cc0-4bfa-80f2-826f3f39139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:16.802109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1343/2692] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:16.819106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:16.831596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee5d3f-52af-40b9-ac68-fc5918f4713e service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:16.837595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad103-d405-4491-afec-f08115427991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:16.838355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad103-d405-4491-afec-f08115427991 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:16.838739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad103-d405-4491-afec-f08115427991 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:16.839081 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad103-d405-4491-afec-f08115427991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:16.848801 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ad103-d405-4491-afec-f08115427991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:16.850554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ad103-d405-4491-afec-f08115427991 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:16.861321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1350/2693] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:20.094418 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551fc1-5595-4a4e-a271-1666db794c3a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:20.094981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551fc1-5595-4a4e-a271-1666db794c3a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:20.094981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551fc1-5595-4a4e-a271-1666db794c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:20.120189 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-89551fc1-5595-4a4e-a271-1666db794c3a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:20.121632 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-89551fc1-5595-4a4e-a271-1666db794c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:20.131398 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1344/2694] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:20.148164 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad103-d405-4491-afec-f08115427991 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:20.149745 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d17ad103-d405-4491-afec-f08115427991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:20.170200 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad103-d405-4491-afec-f08115427991 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:20.176502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:20.177183 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:20.177512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:20.177788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:20.186821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:20.188778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:20.198932 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1351/2695] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:23.134034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6a71-6ff0-4d3b-8a67-dd3b996d626e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:23.134574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6a71-6ff0-4d3b-8a67-dd3b996d626e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:23.134574 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6a71-6ff0-4d3b-8a67-dd3b996d626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:23.155394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3cfc6a71-6ff0-4d3b-8a67-dd3b996d626e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:23.156643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3cfc6a71-6ff0-4d3b-8a67-dd3b996d626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:23.165602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1345/2696] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:23.184626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:23.197588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c67b20-44fe-4f61-9c96-f46b17db9750 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:23.205412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:23.206071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:23.206360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:23.206641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:23.215675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:23.217346 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:23.227532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1352/2697] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:26.319483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e8c3e-0591-4b23-a979-417eb7943c65 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:26.320040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e8c3e-0591-4b23-a979-417eb7943c65 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:26.320040 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e8c3e-0591-4b23-a979-417eb7943c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:26.340334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d51e8c3e-0591-4b23-a979-417eb7943c65 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:26.341863 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d51e8c3e-0591-4b23-a979-417eb7943c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:26.351368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1346/2698] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:26.379647 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:26.391595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cff735-aa16-433f-8d5f-523e5b6fac43 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:26.398187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:26.398875 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:26.399454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:26.399736 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:26.409406 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:26.411411 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:26.424717 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1353/2699] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:29.498394 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68dbe2-293a-4b85-bfd6-d0c3402fafed None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:29.498887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68dbe2-293a-4b85-bfd6-d0c3402fafed None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:29.498989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68dbe2-293a-4b85-bfd6-d0c3402fafed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:29.519770 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7a68dbe2-293a-4b85-bfd6-d0c3402fafed None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:29.521004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7a68dbe2-293a-4b85-bfd6-d0c3402fafed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:29.529817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1347/2700] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:29.550598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:29.562515 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8072a74-e282-4f91-b1ba-b602c7fd0a40 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:29.568480 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:29.569057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:29.569388 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:29.569689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:29.584566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:29.586335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:29.597761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1354/2701] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:31.267168 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d028d4-a4d5-4812-bd02-e445b5f5dd91 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:31.267689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d028d4-a4d5-4812-bd02-e445b5f5dd91 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:31.267792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d028d4-a4d5-4812-bd02-e445b5f5dd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:31.289771 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c3d028d4-a4d5-4812-bd02-e445b5f5dd91 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:31.291024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c3d028d4-a4d5-4812-bd02-e445b5f5dd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:31.356601 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1348/2702] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:31.408509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:31.410365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:31.484046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c8071-3920-45db-88b6-4976cb3f069e service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:31.492102 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:31.492785 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:31.493071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:31.493378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:31.503813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:31.505787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:31.516350 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1355/2703] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:26:31.665644 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a6a3-a533-4c82-beff-aae006ab9337 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:31.665938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a6a3-a533-4c82-beff-aae006ab9337 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:31.666408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a6a3-a533-4c82-beff-aae006ab9337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:31.686985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7ba3a6a3-a533-4c82-beff-aae006ab9337 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:31.688555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7ba3a6a3-a533-4c82-beff-aae006ab9337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:31.696792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1349/2704] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:31.712171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:31.717722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:31.725489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b345c2-a23c-4a8d-9077-b8e157a6112a service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:31.733749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebf66d-f3fa-44a8-87a1-9a40e9cb5b36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:31.734594 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebf66d-f3fa-44a8-87a1-9a40e9cb5b36 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:31.734976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebf66d-f3fa-44a8-87a1-9a40e9cb5b36 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:31.735348 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebf66d-f3fa-44a8-87a1-9a40e9cb5b36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:31.746030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebf66d-f3fa-44a8-87a1-9a40e9cb5b36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:31.747775 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebf66d-f3fa-44a8-87a1-9a40e9cb5b36 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:31.760658 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1356/2705] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 19:26:41.681957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=46 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:41.753776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:47.094929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c271364-7270-40bf-bd89-5c358ad768c2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:47.095595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c271364-7270-40bf-bd89-5c358ad768c2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:47.095595 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c271364-7270-40bf-bd89-5c358ad768c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:47.177019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7c271364-7270-40bf-bd89-5c358ad768c2 None None] MFA Rules not processed for user `2966c9ce7ad74e05b38b0dae3a20ce04`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:47.179767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7c271364-7270-40bf-bd89-5c358ad768c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:47.277680 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1350/2706] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:47.564735 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323897-a660-4bdb-b9a5-ddd248164c38 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:47.566403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323897-a660-4bdb-b9a5-ddd248164c38 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:47.566872 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323897-a660-4bdb-b9a5-ddd248164c38 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:47.568325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1357/2707] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:26:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:26:47.576969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22817-7fdb-4be1-8944-e1c75834b271 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:47.576969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22817-7fdb-4be1-8944-e1c75834b271 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:47.576969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22817-7fdb-4be1-8944-e1c75834b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:47.626197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-71a22817-7fdb-4be1-8944-e1c75834b271 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:47.629796 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-71a22817-7fdb-4be1-8944-e1c75834b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:47.688391 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1351/2708] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:47.712552 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323897-a660-4bdb-b9a5-ddd248164c38 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:47.715642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8a323897-a660-4bdb-b9a5-ddd248164c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:47.855566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323897-a660-4bdb-b9a5-ddd248164c38 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:47.861079 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9de279-25cd-4c46-8ab3-b5f714ea1b9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:47.862624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9de279-25cd-4c46-8ab3-b5f714ea1b9d service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:47.862788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9de279-25cd-4c46-8ab3-b5f714ea1b9d service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:47.863100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9de279-25cd-4c46-8ab3-b5f714ea1b9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:47.874995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9de279-25cd-4c46-8ab3-b5f714ea1b9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:47.877612 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9de279-25cd-4c46-8ab3-b5f714ea1b9d service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:47.909540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1358/2709] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:48.050997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb124b9-0c6b-478a-a7d3-ac677859a6fb None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.051363 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb124b9-0c6b-478a-a7d3-ac677859a6fb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.051754 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb124b9-0c6b-478a-a7d3-ac677859a6fb None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.054541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1352/2710] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:26:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:26:48.060702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5674a-a6d5-472f-b6bb-048c6db71185 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.061299 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5674a-a6d5-472f-b6bb-048c6db71185 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.061756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5674a-a6d5-472f-b6bb-048c6db71185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.084503 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-51b5674a-a6d5-472f-b6bb-048c6db71185 None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:48.086142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-51b5674a-a6d5-472f-b6bb-048c6db71185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:48.092839 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1359/2711] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:26:48.105586 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb124b9-0c6b-478a-a7d3-ac677859a6fb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:48.122510 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb124b9-0c6b-478a-a7d3-ac677859a6fb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:48.132505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d52a7-d74a-48c0-94fc-3600a996c24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:48.133274 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d52a7-d74a-48c0-94fc-3600a996c24a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.133567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d52a7-d74a-48c0-94fc-3600a996c24a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.133847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d52a7-d74a-48c0-94fc-3600a996c24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.144799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d52a7-d74a-48c0-94fc-3600a996c24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:48.147148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d52a7-d74a-48c0-94fc-3600a996c24a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:48.158147 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1353/2712] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:48.270607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946350a6-747f-43c4-b359-9f08ca4ac4ec None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.270607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946350a6-747f-43c4-b359-9f08ca4ac4ec None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.270929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946350a6-747f-43c4-b359-9f08ca4ac4ec None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.272270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1360/2713] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:26:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:26:48.278836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de101416-0e62-4657-adff-24cb7f62ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.279126 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de101416-0e62-4657-adff-24cb7f62ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.279410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de101416-0e62-4657-adff-24cb7f62ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.303918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-de101416-0e62-4657-adff-24cb7f62ffe4 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:48.305344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-de101416-0e62-4657-adff-24cb7f62ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:48.318738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1354/2714] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:26:48.330390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946350a6-747f-43c4-b359-9f08ca4ac4ec None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:48.332414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-946350a6-747f-43c4-b359-9f08ca4ac4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:48.348017 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946350a6-747f-43c4-b359-9f08ca4ac4ec None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:48.352928 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:48.353845 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.354283 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.354718 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.370056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:48.371497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:48.383401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1361/2715] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:48.739516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1e136-e1b6-4458-8f7f-d3a50530e7c7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.739813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1e136-e1b6-4458-8f7f-d3a50530e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.740097 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1e136-e1b6-4458-8f7f-d3a50530e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.761537 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fac1e136-e1b6-4458-8f7f-d3a50530e7c7 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:48.762832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fac1e136-e1b6-4458-8f7f-d3a50530e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:48.774042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1355/2716] 10.222.0.113 () {58 vars in 972 bytes} [Mon Jul 25 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:48.787796 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:48.798384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443deb-b55d-4e94-84c5-d9169e2cf013 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:48.803710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:48.804440 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:48.804792 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:48.805162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:48.814653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:48.816616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:48.825925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1362/2717] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:26:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:26:50.887671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:50.888588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:50.889066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:50.914999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:50.916685 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:50.927068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1356/2718] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:26:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:50.941441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:50.953323 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c660c-b94c-46c9-ae31-cc3bdff9edc4 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:50.959451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:50.960509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:50.960885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:50.961276 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:50.971930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:50.973766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:50.983238 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1363/2719] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:26:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:26:51.176075 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:51.194270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc76b6-c224-4058-82a6-42e29b53e4e6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:51.204567 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:51.208335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:51.208786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:51.209971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] PATH_INFO: `/v3/users/7e9ea61b8bc94d4e8706b93499fe9b81` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:51.214234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9ea61b8bc94d4e8706b93499fe9b81)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:51.219641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:51.327004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9ea61b8bc94d4e8706b93499fe9b81'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.328135 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9ea61b8bc94d4e8706b93499fe9b81'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.329451 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9ea61b8bc94d4e8706b93499fe9b81'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.355592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9ea61b8bc94d4e8706b93499fe9b81'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.369093 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ae84f8d-3515-4a0a-8e2d-117e14eb9d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9ea61b8bc94d4e8706b93499fe9b81'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.393871 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1357/2720] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:26:51 2022] DELETE /identity/v3/users/7e9ea61b8bc94d4e8706b93499fe9b81 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:26:51.626272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:51.640798 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730cec-a6a3-4cb4-939c-6aaa07be7cd3 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:51.762951 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:51.763857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:51.764142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:51.764424 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] PATH_INFO: `/v3/projects/4d24ee3ed9934cebb829c3945de56e4e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:51.765681 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d24ee3ed9934cebb829c3945de56e4e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:51.767621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:51.885201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d24ee3ed9934cebb829c3945de56e4e', 'request_id': 'req-b26948c6-9d56-4286-85a1-61568f568e1b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.895858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d24ee3ed9934cebb829c3945de56e4e', 'request_id': 'req-b26948c6-9d56-4286-85a1-61568f568e1b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.899268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:51.907444 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d24ee3ed9934cebb829c3945de56e4e', 'request_id': 'req-b26948c6-9d56-4286-85a1-61568f568e1b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.928042 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] The token cache is being invalidate because project 4d24ee3ed9934cebb829c3945de56e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:26:51.928822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.929911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b26948c6-9d56-4286-85a1-61568f568e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:26:51.932407 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1364/2721] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:26:51 2022] DELETE /identity/v3/projects/4d24ee3ed9934cebb829c3945de56e4e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:26:51.937929 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:51.938439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:51.938527 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:51.981775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:51.983070 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:52.031923 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:52.067634 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1358/2722] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:52.076400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.077270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.077643 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.105321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:52.106924 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:52.117147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1365/2723] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:26:52.121782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.133052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd2a3-2c0f-42ed-846a-805e0fc39886 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.139086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.140061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.140953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.141557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.142514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:26:52.143033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.144990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.164856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.165100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1359/2724] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:26:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:26:52.177787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665e3cf-836e-4249-9fb7-81e1727b6156 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.184360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.185379 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.186162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.186691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.187642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.190258 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.227032 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1366/2725] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:26:52 2022] POST /identity/v3/projects => generated 368 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:26:52.231243 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.242665 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762568c-1ada-40f2-ac26-c549ae519997 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.310068 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.310759 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.311059 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.311403 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.312115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.314085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.337725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1360/2726] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:26:52 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:26:52.342046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.357045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524790-11ff-45cc-a9c2-81e4146c207f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.364747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.365678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.365965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.366246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.366988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.369038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.381147 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1367/2727] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:26:52 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:26:52.386409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.400115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fe16b-3d78-4fb7-a6e8-0e3ad426957d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.405505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc57ff3-69fa-4728-8ca2-aa641b0ea6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.406204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc57ff3-69fa-4728-8ca2-aa641b0ea6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.406529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc57ff3-69fa-4728-8ca2-aa641b0ea6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.406836 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc57ff3-69fa-4728-8ca2-aa641b0ea6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.407623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc57ff3-69fa-4728-8ca2-aa641b0ea6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.410311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc57ff3-69fa-4728-8ca2-aa641b0ea6b7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.422985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1361/2728] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:26:52 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:26:52.430112 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.442403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6a5d2-3e3c-491a-9d70-fb2b71f91947 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.447329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.448514 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.448810 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.449089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] PATH_INFO: `/v3/projects/51dd26dede6a4b09a8dd789c6154f3a5/users/7d07003e8d994fc9ab356c2919fc1a05/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.466728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51dd26dede6a4b09a8dd789c6154f3a5, user_id=7d07003e8d994fc9ab356c2919fc1a05, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.469432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.485577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1368/2729] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:26:52 2022] PUT /identity/v3/projects/51dd26dede6a4b09a8dd789c6154f3a5/users/7d07003e8d994fc9ab356c2919fc1a05/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:26:52.563047 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eae0f2-b258-4f0f-94b1-f69c9e520e0f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.563333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eae0f2-b258-4f0f-94b1-f69c9e520e0f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.563613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eae0f2-b258-4f0f-94b1-f69c9e520e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.602457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c8eae0f2-b258-4f0f-94b1-f69c9e520e0f None None] MFA Rules not processed for user `7d07003e8d994fc9ab356c2919fc1a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:52.603918 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c8eae0f2-b258-4f0f-94b1-f69c9e520e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:52.700188 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1362/2730] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:52.714938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:52.716746 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:52.782208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f144527-3d3b-4f9d-a2c7-a62788489865 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:52.786382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0573ae51c744a45aeca013357431eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:52.787073 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:52.787358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:52.787638 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:52.797304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:52.798878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:52.808862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1369/2731] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:02.692637 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:02.804996 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=58,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:09.583489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024babe2-bc23-4a29-aea6-37fdcc32a840 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:09.583984 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024babe2-bc23-4a29-aea6-37fdcc32a840 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:09.584095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024babe2-bc23-4a29-aea6-37fdcc32a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:09.628762 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-024babe2-bc23-4a29-aea6-37fdcc32a840 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:09.630117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-024babe2-bc23-4a29-aea6-37fdcc32a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:09.731513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1363/2732] 10.222.0.113 () {58 vars in 972 bytes} [Mon Jul 25 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:09.745817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:09.747275 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:09.855731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9949c-5d1d-42f8-8eaf-c9d0116d3794 service glance] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:09.861460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:09.862136 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:09.862449 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:09.862780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:09.871621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:09.873262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:09.882635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1370/2733] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:27:15.282337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5272513-15c2-4098-b177-54402d56953f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:15.282963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5272513-15c2-4098-b177-54402d56953f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:15.282963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5272513-15c2-4098-b177-54402d56953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:15.357066 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b5272513-15c2-4098-b177-54402d56953f None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:15.358393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b5272513-15c2-4098-b177-54402d56953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:15.451522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1364/2734] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:15.478184 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:15.479722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:15.577511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873857f-eb4c-409a-becb-a4265c1fce5b service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:15.584335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766e8a5-7db0-427c-b942-c975c6178a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:15.584984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766e8a5-7db0-427c-b942-c975c6178a44 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:15.585293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766e8a5-7db0-427c-b942-c975c6178a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:15.585567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766e8a5-7db0-427c-b942-c975c6178a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:15.594171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766e8a5-7db0-427c-b942-c975c6178a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:15.595749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766e8a5-7db0-427c-b942-c975c6178a44 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:15.607341 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1371/2735] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:16.011906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5272513-15c2-4098-b177-54402d56953f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:16.016985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:16.023917 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5272513-15c2-4098-b177-54402d56953f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:16.029721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:16.030603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.030890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.031171 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] PATH_INFO: `/v3/users/7d07003e8d994fc9ab356c2919fc1a05` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.032446 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d07003e8d994fc9ab356c2919fc1a05)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:16.034602 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:16.091569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d07003e8d994fc9ab356c2919fc1a05'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.092626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d07003e8d994fc9ab356c2919fc1a05'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.093699 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d07003e8d994fc9ab356c2919fc1a05'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.107518 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d07003e8d994fc9ab356c2919fc1a05'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.116333 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d07003e8d994fc9ab356c2919fc1a05'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.128874 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1365/2736] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:27:16 2022] DELETE /identity/v3/users/7d07003e8d994fc9ab356c2919fc1a05 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:16.135239 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.135621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.136055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.164433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:16.165662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:16.184990 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:16.227215 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1372/2737] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:16.237033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:16.238881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:16.302143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d3f1-d598-4064-b9e7-cd767abf5572 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:16.306582 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1c1a-0a65-4822-acbd-d102c1a3c80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:16.307229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1c1a-0a65-4822-acbd-d102c1a3c80b service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.307516 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1c1a-0a65-4822-acbd-d102c1a3c80b service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.307786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1c1a-0a65-4822-acbd-d102c1a3c80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.317800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1c1a-0a65-4822-acbd-d102c1a3c80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:16.319226 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1c1a-0a65-4822-acbd-d102c1a3c80b service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:16.329017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1366/2738] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:16.649367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:16.650853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:16.662869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee40a-37dd-4ea9-8748-bde5e5d3c51e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:16.667683 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:16.668560 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.668843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.669141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] PATH_INFO: `/v3/projects/51dd26dede6a4b09a8dd789c6154f3a5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.670355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=51dd26dede6a4b09a8dd789c6154f3a5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:16.672277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:16.722057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51dd26dede6a4b09a8dd789c6154f3a5', 'request_id': 'req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.732821 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51dd26dede6a4b09a8dd789c6154f3a5', 'request_id': 'req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.740479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51dd26dede6a4b09a8dd789c6154f3a5', 'request_id': 'req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.754590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] The token cache is being invalidate because project 51dd26dede6a4b09a8dd789c6154f3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:27:16.755064 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.756106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4485866d-1c7a-40fd-bd83-1c3ff8a2bcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:16.758598 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1373/2739] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:27:16 2022] DELETE /identity/v3/projects/51dd26dede6a4b09a8dd789c6154f3a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:16.765435 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.765727 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.766004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.789483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:16.790719 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:16.860515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1367/2740] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:27:16.870520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.870882 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.871149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.895816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:16.897076 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:16.907632 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1374/2741] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:16.913078 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:16.928841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543ac53-8764-43d0-ab6f-b7e86aede3c5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:16.937426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:16.938491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.938860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.939166 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.940343 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:27:16.940952 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:16.942351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:16.956238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1368/2742] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:27:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:27:16.963153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:16.975943 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090326-ec09-4721-9a05-58e11888d79b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:16.981689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:16.982465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:16.982762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:16.983097 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:16.983758 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:16.985692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:17.017540 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1375/2743] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:27:16 2022] POST /identity/v3/projects => generated 364 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:27:17.021368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:17.027768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:17.031622 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448328d-4ecc-4188-8602-89cb01eadeb9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:17.099505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:17.100219 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:17.100505 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:17.100782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:17.101519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:17.103449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:17.124799 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1369/2744] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:27:17 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:27:17.129672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:17.140639 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61726b0e-557c-496d-ba5b-21de9466b032 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:17.146427 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:17.147108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:17.147394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:17.147672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:17.148433 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:17.150080 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:17.160451 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1376/2745] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:27:17 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:27:17.164566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:17.175012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b6b95-238c-49fe-9544-120bfecee933 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:17.180376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b54ff4-6348-48ad-b0c5-b39b0b0009a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:17.181042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54ff4-6348-48ad-b0c5-b39b0b0009a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:17.181356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54ff4-6348-48ad-b0c5-b39b0b0009a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:17.181657 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54ff4-6348-48ad-b0c5-b39b0b0009a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:17.182364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b54ff4-6348-48ad-b0c5-b39b0b0009a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:17.183956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b54ff4-6348-48ad-b0c5-b39b0b0009a1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:17.199677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1370/2746] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:27:17 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:27:17.204471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:17.216404 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326d48a-ca5c-4dfa-8629-5d7f763f1c0d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:17.222791 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:17.223719 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:17.224000 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:17.224281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] PATH_INFO: `/v3/projects/eac032551209466aac03360c8f0df5c3/users/5e9021fe91ab4da3835c71a93e5f1cf1/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:17.240738 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac032551209466aac03360c8f0df5c3, user_id=5e9021fe91ab4da3835c71a93e5f1cf1, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:17.243367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:17.260135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1377/2747] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:27:17 2022] PUT /identity/v3/projects/eac032551209466aac03360c8f0df5c3/users/5e9021fe91ab4da3835c71a93e5f1cf1/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:17.274352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b464a5-65b4-4094-a95a-f2c8642e7057 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:17.274639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b464a5-65b4-4094-a95a-f2c8642e7057 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:17.274925 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b464a5-65b4-4094-a95a-f2c8642e7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:17.304090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f7b464a5-65b4-4094-a95a-f2c8642e7057 None None] MFA Rules not processed for user `5e9021fe91ab4da3835c71a93e5f1cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:17.305334 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f7b464a5-65b4-4094-a95a-f2c8642e7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:17.373322 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1371/2748] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:17.387655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:17.390685 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:17.441455 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:17.457033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809646a-e9cb-45fd-8462-b050b4fac251 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:17.461674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:17.462389 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:17.462706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:17.462987 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:17.472159 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:17.473730 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:17.483232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1378/2749] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:18.309448 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfcf43-d4a4-4885-9e6d-55332f22e0e4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:18.309991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfcf43-d4a4-4885-9e6d-55332f22e0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:18.309991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfcf43-d4a4-4885-9e6d-55332f22e0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:18.331389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e5bfcf43-d4a4-4885-9e6d-55332f22e0e4 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:18.332625 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e5bfcf43-d4a4-4885-9e6d-55332f22e0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:18.400532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1372/2750] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:27:18.419125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:18.420734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:18.503345 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96643fd-a519-4df2-8c87-6040a4c8a320 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:18.508946 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:18.509642 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:18.509969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:18.510208 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:18.519307 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:18.520935 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:18.530999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1379/2751] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:21.433627 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729567a-f4ce-48e1-9718-2640045c3583 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:21.434229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729567a-f4ce-48e1-9718-2640045c3583 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:21.434229 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729567a-f4ce-48e1-9718-2640045c3583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:21.455275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e729567a-f4ce-48e1-9718-2640045c3583 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:21.456853 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e729567a-f4ce-48e1-9718-2640045c3583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:21.469700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1373/2752] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:21.490443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:21.492160 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:21.508823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea2a5f-e4cf-4334-8a67-f06f351bf3a5 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:21.515693 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:21.516493 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:21.516599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:21.516903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:21.526575 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:21.528167 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:21.538640 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1380/2753] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:24.595368 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15185e79-f04f-46e1-af31-3baca22a5994 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:24.595865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15185e79-f04f-46e1-af31-3baca22a5994 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:24.595969 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15185e79-f04f-46e1-af31-3baca22a5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:24.611370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:24.617933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-15185e79-f04f-46e1-af31-3baca22a5994 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:24.619440 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-15185e79-f04f-46e1-af31-3baca22a5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:24.627717 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1374/2754] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:24.646548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:24.663065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45253-1427-4c38-893f-ef6d4578a133 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:24.670454 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:24.671104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:24.671390 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:24.671662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:24.683125 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:24.684734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:24.695579 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1381/2755] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:27.769647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:27.770197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:27.770197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:27.791482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:27.792722 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:27.802264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1375/2756] 10.222.0.59 () {58 vars in 1020 bytes} [Mon Jul 25 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:27.819725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:27.831772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182d7e-fa22-4061-8e37-c875a0047a64 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:27.838118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:27.838778 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:27.839060 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:27.839339 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:27.848106 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:27.849748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:27.859707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1382/2757] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:37.786012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:37.855423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=58 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:38.806405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:38.807961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:38.913024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12a49b-0d43-4dc6-ae05-7f2a99a03d01 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:38.918439 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01031dc-4339-4418-a903-e64784882618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:38.919121 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01031dc-4339-4418-a903-e64784882618 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:38.919408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01031dc-4339-4418-a903-e64784882618 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:38.919687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01031dc-4339-4418-a903-e64784882618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:38.921669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c01031dc-4339-4418-a903-e64784882618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:38.934112 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01031dc-4339-4418-a903-e64784882618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:38.935693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01031dc-4339-4418-a903-e64784882618 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:38.946993 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1376/2758] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:48.942327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=41 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:50.952115 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:50.965734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584066f-c123-45e9-837a-4f64fd16e271 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:50.972511 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:50.973088 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:50.973400 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:50.973673 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] PATH_INFO: `/v3/users/5e9021fe91ab4da3835c71a93e5f1cf1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:50.975031 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9021fe91ab4da3835c71a93e5f1cf1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:50.976989 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:51.044210 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9021fe91ab4da3835c71a93e5f1cf1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.058134 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9021fe91ab4da3835c71a93e5f1cf1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.058890 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9021fe91ab4da3835c71a93e5f1cf1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.068789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9021fe91ab4da3835c71a93e5f1cf1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.069562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9021fe91ab4da3835c71a93e5f1cf1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.087747 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1383/2759] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:27:50 2022] DELETE /identity/v3/users/5e9021fe91ab4da3835c71a93e5f1cf1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:51.092356 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.092827 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.093096 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.113061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:51.114314 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:51.178937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1377/2760] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:51.191354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:51.192774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:51.278652 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3127c1-2c44-4eb8-9674-3b24b6e0d279 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:51.282956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0a543-23d2-478a-9d60-03f117ed17b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:51.283973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a543-23d2-478a-9d60-03f117ed17b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.284293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a543-23d2-478a-9d60-03f117ed17b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.284576 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a543-23d2-478a-9d60-03f117ed17b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.294224 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a543-23d2-478a-9d60-03f117ed17b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:51.295721 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0a543-23d2-478a-9d60-03f117ed17b7 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:51.305846 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1384/2761] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:51.584051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:51.586052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:51.598704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14815f2c-d58c-427a-9839-043d8c64eba9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:51.604031 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:51.604901 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.605222 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.605500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] PATH_INFO: `/v3/projects/eac032551209466aac03360c8f0df5c3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.606721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac032551209466aac03360c8f0df5c3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:51.608641 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:51.658231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac032551209466aac03360c8f0df5c3', 'request_id': 'req-7cb37b7d-f43b-45fb-af72-08ff72496ba9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.667158 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac032551209466aac03360c8f0df5c3', 'request_id': 'req-7cb37b7d-f43b-45fb-af72-08ff72496ba9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.673711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac032551209466aac03360c8f0df5c3', 'request_id': 'req-7cb37b7d-f43b-45fb-af72-08ff72496ba9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.691710 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] The token cache is being invalidate because project eac032551209466aac03360c8f0df5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:27:51.692033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.692900 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7cb37b7d-f43b-45fb-af72-08ff72496ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:51.695214 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1378/2762] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:27:51 2022] DELETE /identity/v3/projects/eac032551209466aac03360c8f0df5c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:51.701491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.701698 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.701993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.724722 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:51.725970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:51.782980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:51.797209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1385/2763] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:51.805306 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.805677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.805961 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.827108 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:51.828331 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:51.837523 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1379/2764] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:51.842019 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:51.852589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb928f5-bbce-46fa-ad04-8cf6617c70bb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:51.858669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:51.859357 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.859635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.859902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.860624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:27:51.860926 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:51.863050 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:51.875633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1386/2765] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:27:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:27:51.880067 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:51.889420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807137-55bc-4986-a7a5-0fb66ed95d0a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:51.894839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:51.895489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:51.895760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:51.896038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:51.896734 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:51.898742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:51.927167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1380/2766] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:27:51 2022] POST /identity/v3/projects => generated 376 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:27:51.932616 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:51.943430 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec1546-b6aa-4061-b585-6f742c222ef4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:52.012304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:52.012963 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:52.013181 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:52.013496 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:52.014193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:52.016093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:52.040644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1387/2767] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:27:51 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:27:52.046200 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:52.057238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972a9e-19eb-44ab-83fa-f5514bccae56 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:52.063004 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:52.063679 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:52.063962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:52.064237 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:52.065405 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:52.067036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:52.077949 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1381/2768] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:27:52 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:27:52.082700 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:52.092940 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e7d6a-d58d-4943-93b9-647298e71e8f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:52.098867 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14533df8-2d8c-4212-b692-849a37b9fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:52.099536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533df8-2d8c-4212-b692-849a37b9fa4b admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:52.099817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533df8-2d8c-4212-b692-849a37b9fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:52.100089 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533df8-2d8c-4212-b692-849a37b9fa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:52.100813 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14533df8-2d8c-4212-b692-849a37b9fa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:52.102452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14533df8-2d8c-4212-b692-849a37b9fa4b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:52.114216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1388/2769] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:27:52 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:27:52.118524 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:52.129751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299be4-4218-424f-a8d7-caa5167b5967 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:52.135085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:52.135970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:52.136239 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:52.136520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] PATH_INFO: `/v3/projects/6bc133d28a9e4ca18c63607bc1807271/users/24f528dd54fe45be8b85548d324876f2/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:52.152313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc133d28a9e4ca18c63607bc1807271, user_id=24f528dd54fe45be8b85548d324876f2, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:52.155012 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:52.173457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1382/2770] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:27:52 2022] PUT /identity/v3/projects/6bc133d28a9e4ca18c63607bc1807271/users/24f528dd54fe45be8b85548d324876f2/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:52.185333 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:52.185744 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:52.185927 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:52.215539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] MFA Rules not processed for user `24f528dd54fe45be8b85548d324876f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:52.216765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:52.297973 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1389/2771] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:52.308787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:52.310515 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:52.335482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:52.397526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b7517-459e-408f-bb4a-0ee725285bde admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:52.401587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:52.402252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:52.402544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:52.402824 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:52.413017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:52.414688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:52.425447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1383/2772] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:58.736428 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:58.738704 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:58.821621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:58.840916 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481a3b-f2b5-4553-86e3-6d70433e3112 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:58.847272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:58.848288 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:58.848664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:58.849030 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] PATH_INFO: `/v3/users/2966c9ce7ad74e05b38b0dae3a20ce04` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:58.850422 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2966c9ce7ad74e05b38b0dae3a20ce04)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:58.852527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:58.920105 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2966c9ce7ad74e05b38b0dae3a20ce04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:58.934895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2966c9ce7ad74e05b38b0dae3a20ce04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:58.936061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2966c9ce7ad74e05b38b0dae3a20ce04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:58.945007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2966c9ce7ad74e05b38b0dae3a20ce04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:58.945876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4ed2658d-bf77-412f-953e-8b2e6c3dc30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2966c9ce7ad74e05b38b0dae3a20ce04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:58.961850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1390/2773] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:27:58 2022] DELETE /identity/v3/users/2966c9ce7ad74e05b38b0dae3a20ce04 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:59.170489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.191317 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ff3d3-501c-4f26-8407-9620f061067e service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.278401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.278401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.278401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.278401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] PATH_INFO: `/v3/projects/f372b02e6e4345069c60f9e072f3f27e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.278797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f372b02e6e4345069c60f9e072f3f27e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.278797 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.330037 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f372b02e6e4345069c60f9e072f3f27e', 'request_id': 'req-9286ad63-519a-4b13-a262-4e751265f184'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:59.340611 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f372b02e6e4345069c60f9e072f3f27e', 'request_id': 'req-9286ad63-519a-4b13-a262-4e751265f184'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:59.348117 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f372b02e6e4345069c60f9e072f3f27e', 'request_id': 'req-9286ad63-519a-4b13-a262-4e751265f184'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:59.361150 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] The token cache is being invalidate because project f372b02e6e4345069c60f9e072f3f27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:27:59.361741 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:59.363425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9286ad63-519a-4b13-a262-4e751265f184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:27:59.365072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1384/2774] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:27:59 2022] DELETE /identity/v3/projects/f372b02e6e4345069c60f9e072f3f27e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:59.370016 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.370354 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.370635 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.402678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:59.403905 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:59.493862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1391/2775] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:59.501605 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.501937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.502428 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.523429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:59.525318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:59.534667 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1385/2776] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:59.539285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.551384 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cbe56-bcdf-4bf9-bde9-cc166559debe None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.556763 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.557484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.557828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.558035 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.558782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:27:59.558782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.560674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.577146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1392/2777] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:27:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:27:59.578695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.589279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20465a2b-3b62-4da5-9d53-f7a58aee76c5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.594921 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.595963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.596283 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.596587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.597501 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.599499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.635199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1386/2778] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:27:59 2022] POST /identity/v3/projects => generated 398 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:27:59.636856 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.649991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74763cb-85ce-4b97-b240-7051006f3e7a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.706739 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:59.713755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.714672 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.715176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.715858 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.716770 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.718868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.745161 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1393/2779] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:27:59 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:27:59.746552 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.753642 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:59.758139 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae7bc8-ed66-4ca9-890e-eff9e341fb4e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.765608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.767170 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.767878 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.768351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.769362 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.770968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.782000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1387/2780] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:27:59 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:27:59.786277 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.796789 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1d54-7eda-40c9-a378-24f4777062a1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.801911 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f484d6-bf30-4bc2-a5e3-c78e0381a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.802675 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f484d6-bf30-4bc2-a5e3-c78e0381a2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.803027 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f484d6-bf30-4bc2-a5e3-c78e0381a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.803395 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f484d6-bf30-4bc2-a5e3-c78e0381a2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.804187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f484d6-bf30-4bc2-a5e3-c78e0381a2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.805919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f484d6-bf30-4bc2-a5e3-c78e0381a2c6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.820075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1394/2781] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:27:59 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:27:59.821393 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.832427 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e9ffa-4070-44f9-a203-eb8660e9a4c6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:59.837490 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:59.838388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.838671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.839027 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] PATH_INFO: `/v3/projects/a85f8777293a4c21b73b36c3aef9e514/users/91ca992668584898a3b207e66c70c174/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.856953 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85f8777293a4c21b73b36c3aef9e514, user_id=91ca992668584898a3b207e66c70c174, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:59.859705 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:59.875199 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1388/2782] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:27:59 2022] PUT /identity/v3/projects/a85f8777293a4c21b73b36c3aef9e514/users/91ca992668584898a3b207e66c70c174/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:27:59.887129 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2672b-fdea-4820-9ffe-1e8c43a14ac0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:59.887423 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2672b-fdea-4820-9ffe-1e8c43a14ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:59.887699 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2672b-fdea-4820-9ffe-1e8c43a14ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:59.917965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-66f2672b-fdea-4820-9ffe-1e8c43a14ac0 None None] MFA Rules not processed for user `91ca992668584898a3b207e66c70c174`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:27:59.919195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-66f2672b-fdea-4820-9ffe-1e8c43a14ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:59.985234 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1395/2783] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:27:59.996726 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:59.998566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:00.058352 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c294-f371-472d-95bc-ccaa7e2cb35e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:00.062193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:00.062859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:00.063130 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:00.063402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:00.072769 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:00.074263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:00.083997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1389/2784] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:00.587078 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2fac-fd1a-4172-8123-bf0fb4c4564e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:00.587374 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2fac-fd1a-4172-8123-bf0fb4c4564e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:00.587651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2fac-fd1a-4172-8123-bf0fb4c4564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:00.608881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cdbd2fac-fd1a-4172-8123-bf0fb4c4564e None None] MFA Rules not processed for user `d64b7e00cfd748f9b0497c977cc08d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:00.610155 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cdbd2fac-fd1a-4172-8123-bf0fb4c4564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:00.669409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1396/2785] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:02.879499 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:02.881247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:02.963742 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9229eb-3ad6-4dc9-8ef6-189f94b7c3fd service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:02.970540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:02.971696 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:02.972045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:02.972471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] PATH_INFO: `/v3/users/24f528dd54fe45be8b85548d324876f2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:02.973926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f528dd54fe45be8b85548d324876f2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:02.976065 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:03.029896 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f528dd54fe45be8b85548d324876f2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:03.030738 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f528dd54fe45be8b85548d324876f2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:03.031358 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f528dd54fe45be8b85548d324876f2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:03.044232 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f528dd54fe45be8b85548d324876f2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:03.054001 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f528dd54fe45be8b85548d324876f2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:03.056370 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:03.072464 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1390/2786] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:28:02 2022] DELETE /identity/v3/users/24f528dd54fe45be8b85548d324876f2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:28:03.077418 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:03.078248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:03.078599 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:03.115054 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:03.116860 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:03.197465 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1397/2787] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:03.228985 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:03.231277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:03.293454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f71f-de22-4125-8849-07bb96ebaead admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:03.297569 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689c9c2-fe61-43ac-9acd-d09997c2893a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:03.298286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689c9c2-fe61-43ac-9acd-d09997c2893a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:03.298544 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689c9c2-fe61-43ac-9acd-d09997c2893a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:03.299180 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689c9c2-fe61-43ac-9acd-d09997c2893a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:03.308765 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689c9c2-fe61-43ac-9acd-d09997c2893a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:03.310313 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689c9c2-fe61-43ac-9acd-d09997c2893a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:03.321561 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1391/2788] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:04.103588 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.106697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:04.131335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772a41e-d66b-4bf9-99d2-de4a2218fefe None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.138586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.139342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.139773 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.140119 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] PATH_INFO: `/v3/projects/6bc133d28a9e4ca18c63607bc1807271` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.141441 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc133d28a9e4ca18c63607bc1807271)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.144372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.153509 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:04.229843 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc133d28a9e4ca18c63607bc1807271', 'request_id': 'req-8f99c84d-e12e-470b-90c9-086c031c4f22'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:04.239833 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc133d28a9e4ca18c63607bc1807271', 'request_id': 'req-8f99c84d-e12e-470b-90c9-086c031c4f22'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:04.248795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc133d28a9e4ca18c63607bc1807271', 'request_id': 'req-8f99c84d-e12e-470b-90c9-086c031c4f22'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:04.265878 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] The token cache is being invalidate because project 6bc133d28a9e4ca18c63607bc1807271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:28:04.266360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:04.267235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f99c84d-e12e-470b-90c9-086c031c4f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:04.269784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1398/2789] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:28:04 2022] DELETE /identity/v3/projects/6bc133d28a9e4ca18c63607bc1807271 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:04.274846 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.275388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.275388 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.297376 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:04.299666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:04.390030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1392/2790] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:04.397869 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.398468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.398761 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.422187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:04.423489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:04.432756 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1399/2791] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:04.436852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.447250 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de2c0-4ceb-43cc-bd0c-01f2af17a46b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.452410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.453269 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.453414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.453694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.454423 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:28:04.454867 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.456731 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.469800 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1393/2792] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:28:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:28:04.474325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.484382 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93446f-2706-44fc-b722-4ccd8f87f12a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.489969 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.490728 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.491014 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.491974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.492682 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.494649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.525815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1400/2793] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:28:04 2022] POST /identity/v3/projects => generated 372 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:28:04.529979 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.541978 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740d9c1-45fb-43e7-b1ac-7fd5d1131f26 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.605573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.606178 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.606476 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.606744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.607463 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.609454 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.634500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1394/2794] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:28:04 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:28:04.638589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.651107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cced3-03af-439e-b474-f115deff6e85 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.657214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.657956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.658235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.658601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.659331 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.660984 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.672251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1401/2795] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:28:04 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:28:04.676626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.687280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9131-da05-40c6-9067-494beedce9e5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.693143 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dd375-3f04-409b-83a6-0f28782b98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.693913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd375-3f04-409b-83a6-0f28782b98ff admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.694204 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd375-3f04-409b-83a6-0f28782b98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.694483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd375-3f04-409b-83a6-0f28782b98ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.695354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dd375-3f04-409b-83a6-0f28782b98ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.697000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dd375-3f04-409b-83a6-0f28782b98ff admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.703049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:04.710808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1395/2796] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:28:04 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:28:04.714568 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.727187 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576244a5-3328-4a0c-9ac9-1ac8e8e45ddd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.732058 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.732988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.733314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.733597 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] PATH_INFO: `/v3/projects/c8a3878f16a345ec95296001dde3a933/users/2e55553f8a6d4c9fbc1954bb761b5cf5/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.749767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a3878f16a345ec95296001dde3a933, user_id=2e55553f8a6d4c9fbc1954bb761b5cf5, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.752561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.766863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1402/2797] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:28:04 2022] PUT /identity/v3/projects/c8a3878f16a345ec95296001dde3a933/users/2e55553f8a6d4c9fbc1954bb761b5cf5/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:04.773014 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.773360 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.773646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.794565 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:04.795792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:04.859633 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1396/2798] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:04.870149 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:04.873207 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:04.937534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82687922-847c-4a20-9378-d31243b6f8ee admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:04.941549 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14cd5d-dd9c-4b82-bde6-832f1a559b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:04.942209 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14cd5d-dd9c-4b82-bde6-832f1a559b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:04.942492 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14cd5d-dd9c-4b82-bde6-832f1a559b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:04.942767 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14cd5d-dd9c-4b82-bde6-832f1a559b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:04.953291 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14cd5d-dd9c-4b82-bde6-832f1a559b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:04.954938 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14cd5d-dd9c-4b82-bde6-832f1a559b90 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:04.964742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1403/2799] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:05.208241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:05.210301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:05.223514 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d6d0-f1d1-49a8-ac52-62df88f707da None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:05.228941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:05.229927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:05.230300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:05.230648 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] PATH_INFO: `/v3/users/91ca992668584898a3b207e66c70c174` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:05.232053 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ca992668584898a3b207e66c70c174)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:05.234273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:05.308153 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ca992668584898a3b207e66c70c174'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:05.309596 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ca992668584898a3b207e66c70c174'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:05.310303 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ca992668584898a3b207e66c70c174'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:05.324225 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ca992668584898a3b207e66c70c174'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:05.333155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ca992668584898a3b207e66c70c174'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:05.346421 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1397/2800] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:28:05 2022] DELETE /identity/v3/users/91ca992668584898a3b207e66c70c174 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:28:05.351497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:05.351997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:05.352084 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:05.374005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:05.375269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:05.417201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:05.449713 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1404/2801] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:05.463449 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:05.464963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:05.527175 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071f57-1bcd-4c3c-b2a1-86b296f35024 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:05.531090 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e9c50-dded-46a4-91dc-b5c3d6859cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:05.531758 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e9c50-dded-46a4-91dc-b5c3d6859cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:05.532049 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e9c50-dded-46a4-91dc-b5c3d6859cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:05.532408 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e9c50-dded-46a4-91dc-b5c3d6859cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:05.544957 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e9c50-dded-46a4-91dc-b5c3d6859cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:05.548025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e9c50-dded-46a4-91dc-b5c3d6859cf1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:05.564971 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1398/2802] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:06.218880 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:06.220978 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:06.234435 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d5d1-386a-4e37-b622-ea68771372ea None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:06.239627 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:06.240536 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:06.240822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:06.241099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] PATH_INFO: `/v3/projects/a85f8777293a4c21b73b36c3aef9e514` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:06.242366 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85f8777293a4c21b73b36c3aef9e514)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:06.244363 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:06.314315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85f8777293a4c21b73b36c3aef9e514', 'request_id': 'req-7f770fa5-219f-4697-8291-94f9e9945f94'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:06.331334 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85f8777293a4c21b73b36c3aef9e514', 'request_id': 'req-7f770fa5-219f-4697-8291-94f9e9945f94'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:06.342533 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85f8777293a4c21b73b36c3aef9e514', 'request_id': 'req-7f770fa5-219f-4697-8291-94f9e9945f94'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:06.359889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] The token cache is being invalidate because project a85f8777293a4c21b73b36c3aef9e514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:28:06.361162 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:06.362783 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:06.366980 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1405/2803] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:28:06 2022] DELETE /identity/v3/projects/a85f8777293a4c21b73b36c3aef9e514 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:09.511915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:09.512477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:09.512477 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:09.543689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] MFA Rules not processed for user `2e55553f8a6d4c9fbc1954bb761b5cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:09.544990 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:09.549491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:09.632159 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1399/2804] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:09.636412 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:09.637962 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:09.704582 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770fa5-219f-4697-8291-94f9e9945f94 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:09.709637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:09.710313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:09.710600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:09.710879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:09.711580 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:09.713583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:09.743472 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1406/2805] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:28:09 2022] POST /identity/v3/projects => generated 372 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:28:09.747842 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:09.759473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e619fb-80e2-4656-9500-ae31aaef024b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:09.823511 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:09.824203 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:09.824491 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:09.825095 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:09.825850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:09.827787 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:09.851107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1400/2806] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:28:09 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:28:09.855126 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:09.865554 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f09f-a4b3-412f-b5ff-0dcd7f6e95f1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:09.870563 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:09.871250 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:09.871537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:09.871815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:09.872902 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:09.874246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:09.885915 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1407/2807] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:28:09 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:28:09.890281 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:09.900636 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb8cfd-5f23-47f4-be17-7cab47d391ac admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:09.905575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:09.906520 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:09.906786 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:09.907832 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] PATH_INFO: `/v3/projects/182670592a4b4de9adf8161c66d07c34/users/8ef4dbd3d24642e1b9fa4094d5f6dee7/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:09.923776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182670592a4b4de9adf8161c66d07c34, user_id=8ef4dbd3d24642e1b9fa4094d5f6dee7, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:09.926540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:09.941591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1401/2808] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:28:09 2022] PUT /identity/v3/projects/182670592a4b4de9adf8161c66d07c34/users/8ef4dbd3d24642e1b9fa4094d5f6dee7/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:09.946505 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:09.957651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52e121-ebae-46a6-863e-40f4c7b12867 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:09.991040 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:10.030668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638559a9-c1f2-459f-977b-991bad9e7ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:10.031378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638559a9-c1f2-459f-977b-991bad9e7ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:10.031748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638559a9-c1f2-459f-977b-991bad9e7ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:10.031930 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638559a9-c1f2-459f-977b-991bad9e7ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:10.033241 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638559a9-c1f2-459f-977b-991bad9e7ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:10.035737 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638559a9-c1f2-459f-977b-991bad9e7ec0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:10.052011 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1408/2809] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:28:09 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:28:10.055906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:10.069177 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74314ad-fdbe-4935-9d73-826f8a093635 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:10.076103 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:10.078940 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:10.080607 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:10.080946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] PATH_INFO: `/v3/projects/182670592a4b4de9adf8161c66d07c34/users/8ef4dbd3d24642e1b9fa4094d5f6dee7/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:10.085387 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=182670592a4b4de9adf8161c66d07c34, user_id=8ef4dbd3d24642e1b9fa4094d5f6dee7, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:10.089061 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:10.107677 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1402/2810] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:28:10 2022] PUT /identity/v3/projects/182670592a4b4de9adf8161c66d07c34/users/8ef4dbd3d24642e1b9fa4094d5f6dee7/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:15.645907 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07612cc-ac3a-43fe-ab28-e2d496c236a0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:15.646367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07612cc-ac3a-43fe-ab28-e2d496c236a0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:15.646484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07612cc-ac3a-43fe-ab28-e2d496c236a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:15.688169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d07612cc-ac3a-43fe-ab28-e2d496c236a0 None None] MFA Rules not processed for user `8ef4dbd3d24642e1b9fa4094d5f6dee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:15.690101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d07612cc-ac3a-43fe-ab28-e2d496c236a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:15.785487 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1409/2811] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:15.800704 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:15.802522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:15.935545 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:15.981509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a4bb2-136d-4ac9-8f1b-5b654c052f2d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:15.991430 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:15.992264 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:15.992621 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:15.992962 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:16.087321 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:16.090354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:16.111202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1403/2812] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:17.578170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:17.578625 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:17.578807 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:17.605974 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] MFA Rules not processed for user `2e55553f8a6d4c9fbc1954bb761b5cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:17.607467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:17.620041 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1410/2813] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:26.102447 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=30 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:27.599919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=52 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:44.691834 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:44.693794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:44.760017 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441e29f-52be-4311-9d22-ee5cf456d1fc service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:44.766234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:44.767101 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:44.767379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:44.767711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:44.778606 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:44.780052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:44.789819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1404/2814] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:54.785813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=26 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:13.818797 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:13.820602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:13.836859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1db2e-9737-4951-982b-4de7ef9e0009 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:13.841881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:13.842571 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:13.842854 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:13.843127 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:13.845332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:13.867065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:13.868884 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fdaac-7f7b-48af-89bb-739cd61098b8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:13.880262 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1411/2815] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:17.453483 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:17.463293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322e2be-8bca-4353-aacb-81014787f1d2 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:17.467051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:17.467697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:17.467983 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:17.468256 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:17.470069 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:17.483947 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:17.485414 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:17.497138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1405/2816] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:23.875537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:24.519994 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf013-0506-4236-93bd-a45433e774a9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:24.520281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf013-0506-4236-93bd-a45433e774a9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:24.520561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf013-0506-4236-93bd-a45433e774a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:24.541179 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-901bf013-0506-4236-93bd-a45433e774a9 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:29:24.542457 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-901bf013-0506-4236-93bd-a45433e774a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:24.606774 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1412/2817] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:29:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:29:24.658137 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:24.659682 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:24.735927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf76311-50b8-4fec-8c12-15af497ad533 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:24.741254 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d75f92-615c-4c2e-9bd5-24727c2bf263 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:24.741927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75f92-615c-4c2e-9bd5-24727c2bf263 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:24.742212 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75f92-615c-4c2e-9bd5-24727c2bf263 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:24.742495 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75f92-615c-4c2e-9bd5-24727c2bf263 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:24.752022 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75f92-615c-4c2e-9bd5-24727c2bf263 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:24.754271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75f92-615c-4c2e-9bd5-24727c2bf263 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:24.763478 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1406/2818] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:29:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:29:34.599489 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:34.760146 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=38 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:38.000802 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5670611-fb51-48a2-8735-8abd9c0171d9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:38.001349 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5670611-fb51-48a2-8735-8abd9c0171d9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:38.001859 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5670611-fb51-48a2-8735-8abd9c0171d9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:38.003061 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1413/2819] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:29:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:29:38.009297 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fdfe9-7ddf-45d0-aaac-39b280314591 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:38.009768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fdfe9-7ddf-45d0-aaac-39b280314591 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:38.009965 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fdfe9-7ddf-45d0-aaac-39b280314591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:38.053373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3f0fdfe9-7ddf-45d0-aaac-39b280314591 None None] MFA Rules not processed for user `15cfb6d527464ccaad7db841e3eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:29:38.054612 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f0fdfe9-7ddf-45d0-aaac-39b280314591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:38.064858 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1407/2820] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:29:38.078946 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5670611-fb51-48a2-8735-8abd9c0171d9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:38.091434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5670611-fb51-48a2-8735-8abd9c0171d9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:38.095816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:38.096470 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:38.096748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:38.097156 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:38.108358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:38.109822 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:38.122033 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1414/2821] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:39.838691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07bc0-411e-4564-be29-b3b892e68b84 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:39.839185 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07bc0-411e-4564-be29-b3b892e68b84 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:39.839300 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07bc0-411e-4564-be29-b3b892e68b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:39.897385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a9f07bc0-411e-4564-be29-b3b892e68b84 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:29:39.898531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a9f07bc0-411e-4564-be29-b3b892e68b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:39.917546 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1408/2822] 10.222.0.113 () {58 vars in 1014 bytes} [Mon Jul 25 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:29:39.929826 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:39.953135 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c562-c363-4098-9f45-e0d99971af9d service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:39.958827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:39.959485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:39.959772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:39.960052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:39.968842 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:39.970519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:39.978988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1415/2823] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:29:49.914465 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=27 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:49.975780 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=16 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:56.014496 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:56.015025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:56.015025 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:56.034725 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] MFA Rules not processed for user `8f175454d9b245fc88b69aa73568b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:29:56.035938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:56.043809 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1409/2824] 10.222.0.113 () {58 vars in 972 bytes} [Mon Jul 25 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:29:56.059396 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:56.071829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaa6ee-5bb8-4474-b0ea-aae3f72e2f9d service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:56.078518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2e01af3550b4e638343e176888a21aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:56.079414 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:56.080003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:56.080286 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:56.089221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:56.090795 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:56.102193 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1416/2825] 10.222.0.113 () {60 vars in 1389 bytes} [Mon Jul 25 19:29:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:30:06.030114 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:06.096633 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:18.588444 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:18.609850 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35bc9a-1372-4f31-a542-17f9584caf35 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:18.614720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:18.615381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:18.615671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:18.615956 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:18.618354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:18.630046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:18.631488 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:18.639897 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1410/2826] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:28.636445 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:30.516077 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:30.517849 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:30.578648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6768dfa-a0e7-4fa0-a9bf-e780dc62ec2c service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:30.583075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:30.583804 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:30.584001 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:30.584302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:30.586485 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:30.650372 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:30.651748 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:30.661308 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1417/2827] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:33.457359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:33.461528 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:33.506760 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023463-0d96-4d46-ac04-72511e6ee19a service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:33.515728 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:33.517193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:33.517810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:33.518187 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:33.521410 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:33.558910 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:33.560880 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:33.593718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1411/2828] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:37.726537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:37.736912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77592b2d-adf5-497f-aba0-1656606a9f8d service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:37.741232 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:37.741891 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:37.742170 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:37.742439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:37.744409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:37.818305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:37.819828 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:37.830787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1418/2829] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:41.072304 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:41.073924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:41.142689 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:41.144201 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:41.159890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b084-ad7d-49c5-b7fb-3a11447eafe2 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:41.164718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:41.165691 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.166052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.166409 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.167551 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2908f-b089-4dc6-905b-dd68de1557a8 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:41.169202 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:41.172877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:41.173895 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.174375 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.174650 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] PATH_INFO: `/v3/users/d64b7e00cfd748f9b0497c977cc08d26` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.175917 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64b7e00cfd748f9b0497c977cc08d26)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:41.177975 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:41.183458 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:41.185869 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:41.198276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1412/2830] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:41.233063 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:41.236908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64b7e00cfd748f9b0497c977cc08d26'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.255942 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64b7e00cfd748f9b0497c977cc08d26'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.256710 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64b7e00cfd748f9b0497c977cc08d26'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.264782 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64b7e00cfd748f9b0497c977cc08d26'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.265920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b8346975-852b-4e38-b72a-5b751ee86c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64b7e00cfd748f9b0497c977cc08d26'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.281679 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1419/2831] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:41 2022] DELETE /identity/v3/users/d64b7e00cfd748f9b0497c977cc08d26 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:30:41.470946 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:41.482277 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb731-eda6-4b5a-9fc6-678b87109a6b service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:41.545169 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:41.546251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.546666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.546920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] PATH_INFO: `/v3/projects/38abbc7a672e49edaf9be58c6253248e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.548247 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=38abbc7a672e49edaf9be58c6253248e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:41.550209 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:41.601452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38abbc7a672e49edaf9be58c6253248e', 'request_id': 'req-d9d5fa94-8234-47a1-946c-85fc55e176ad'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.610028 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38abbc7a672e49edaf9be58c6253248e', 'request_id': 'req-d9d5fa94-8234-47a1-946c-85fc55e176ad'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.615873 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38abbc7a672e49edaf9be58c6253248e', 'request_id': 'req-d9d5fa94-8234-47a1-946c-85fc55e176ad'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.628948 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] The token cache is being invalidate because project 38abbc7a672e49edaf9be58c6253248e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:41.629251 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.630039 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d9d5fa94-8234-47a1-946c-85fc55e176ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:41.632392 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1413/2832] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:41 2022] DELETE /identity/v3/projects/38abbc7a672e49edaf9be58c6253248e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:41.637377 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.637670 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.637948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.665141 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:41.666401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:41.735741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1420/2833] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:41.743429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.743720 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.744152 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.760324 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:41.766532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:41.768801 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:41.778999 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1414/2834] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:41.783481 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:41.795600 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdabd75-3c2d-44d4-a56b-8433f4ba066e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:41.800577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:41.801293 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.801577 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.801855 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.802595 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:30:41.803043 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:41.804664 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:41.818697 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1421/2835] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:30:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:30:41.821913 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:41.831810 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135efb5-a12a-4c1c-8f15-a93318ee6465 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:41.836794 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:41.837493 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.838010 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.838292 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.839000 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:41.840928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:41.883933 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1415/2836] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:30:41 2022] POST /identity/v3/projects => generated 372 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:41.885165 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:41.896169 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e41fb-8922-4439-8342-91bee17ceaff admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:41.957929 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:41.958623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:41.958912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:41.959191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:41.959903 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:41.961883 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:41.984755 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1422/2837] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:30:41 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:30:41.990557 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.001819 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0230-3e85-444e-9a25-d50a1f3deae8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.006694 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.007359 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.007643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.007924 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.008663 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.010289 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.021045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1416/2838] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:41 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:42.025196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.036443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1035e6-f302-4fc1-b3eb-32cd3bb36b51 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.041707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3927-b207-4965-89c0-725d004b5fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.042376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3927-b207-4965-89c0-725d004b5fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.042655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3927-b207-4965-89c0-725d004b5fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.042925 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3927-b207-4965-89c0-725d004b5fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.043648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f3927-b207-4965-89c0-725d004b5fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.045304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f3927-b207-4965-89c0-725d004b5fc4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.056402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1423/2839] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:42 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:30:42.060631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.073181 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67188ad8-3541-4f69-87c2-ee6a66d40d3d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.080325 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.081626 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.081973 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.082337 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] PATH_INFO: `/v3/projects/8bdf200ba70043ccad354aae6f6cb4c2/users/ad144fd1e03e4810a60a898e01439fe8/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.101554 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdf200ba70043ccad354aae6f6cb4c2, user_id=ad144fd1e03e4810a60a898e01439fe8, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.104252 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.119381 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1417/2840] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:42 2022] PUT /identity/v3/projects/8bdf200ba70043ccad354aae6f6cb4c2/users/ad144fd1e03e4810a60a898e01439fe8/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:42.186653 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.187233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.187233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.218702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] MFA Rules not processed for user `ad144fd1e03e4810a60a898e01439fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:42.219936 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:42.233272 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:42.290626 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1424/2841] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:42.296401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.363234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f353-9412-4ed0-9d60-55296fff2e59 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.369032 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.369729 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.370016 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.370327 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.371030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.372951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.403318 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1418/2842] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:30:42 2022] POST /identity/v3/projects => generated 374 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:42.407335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.418966 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459ded-1df9-4a8e-892a-8d59c8435d90 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.484401 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.485071 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.485364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.485637 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.486329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.488316 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.511028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1425/2843] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:30:42 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:42.515193 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.525954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaf9d2-ecc7-46fa-855e-f213758c523d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.531899 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.532562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.532844 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.533142 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.533883 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.535473 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.546613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1419/2844] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:42 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:42.553206 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.569278 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670620-81f8-4dc7-82ff-804a4b48c2c6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.577565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.578651 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.578937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.579216 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] PATH_INFO: `/v3/projects/642075aee633494fa61f78e879d320ba/users/a1f00250ff254013b7392c97bdcb166d/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.595772 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642075aee633494fa61f78e879d320ba, user_id=a1f00250ff254013b7392c97bdcb166d, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.598648 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.614287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1426/2845] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:42 2022] PUT /identity/v3/projects/642075aee633494fa61f78e879d320ba/users/a1f00250ff254013b7392c97bdcb166d/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:42.618236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.629080 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e286264-e44d-402b-8898-73b2bbe64374 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.689647 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748180b-e6f3-4f5f-b601-3c09e16617c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.690323 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748180b-e6f3-4f5f-b601-3c09e16617c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.690609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748180b-e6f3-4f5f-b601-3c09e16617c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.690886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748180b-e6f3-4f5f-b601-3c09e16617c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.691623 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748180b-e6f3-4f5f-b601-3c09e16617c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.693288 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748180b-e6f3-4f5f-b601-3c09e16617c3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.704312 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1420/2846] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:42 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:42.708794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.719677 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54ba8-7eb5-4b3b-aa4f-90797e2b3986 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.724771 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.725701 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.725982 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.726261 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] PATH_INFO: `/v3/projects/642075aee633494fa61f78e879d320ba/users/a1f00250ff254013b7392c97bdcb166d/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.728452 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642075aee633494fa61f78e879d320ba, user_id=a1f00250ff254013b7392c97bdcb166d, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.731144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.742146 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1427/2847] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:42 2022] PUT /identity/v3/projects/642075aee633494fa61f78e879d320ba/users/a1f00250ff254013b7392c97bdcb166d/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:42.753492 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.753943 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.754389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.767916 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:42.791213 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] MFA Rules not processed for user `a1f00250ff254013b7392c97bdcb166d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:42.792457 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:42.873792 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1421/2848] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:42.888794 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:42.894090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:42.955711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd09d0-b0ff-443d-8bd8-128507e0cea2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:42.959976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcd06d-aae7-449e-adf3-82827a1b18c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:42.960641 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcd06d-aae7-449e-adf3-82827a1b18c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:42.960960 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcd06d-aae7-449e-adf3-82827a1b18c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:42.961290 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcd06d-aae7-449e-adf3-82827a1b18c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:42.974176 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcd06d-aae7-449e-adf3-82827a1b18c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:42.975630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcd06d-aae7-449e-adf3-82827a1b18c7 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:42.986488 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1428/2849] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:43.417519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:43.492489 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1743ff-c098-4785-b4b5-bcb7649a7d34 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:43.497718 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:43.498591 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:43.498963 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:43.499429 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] PATH_INFO: `/v3/users/ad144fd1e03e4810a60a898e01439fe8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:43.500766 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad144fd1e03e4810a60a898e01439fe8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:43.502743 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:43.554140 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad144fd1e03e4810a60a898e01439fe8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:43.554813 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad144fd1e03e4810a60a898e01439fe8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:43.555415 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad144fd1e03e4810a60a898e01439fe8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:43.573227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad144fd1e03e4810a60a898e01439fe8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:43.582578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad144fd1e03e4810a60a898e01439fe8'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:43.595603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1422/2850] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:43 2022] DELETE /identity/v3/users/ad144fd1e03e4810a60a898e01439fe8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:43.600429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:43.600948 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:43.601056 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:43.622287 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:43.623512 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:43.629715 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:43.688596 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1429/2851] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:43.699263 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:43.700928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:43.713217 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:43.766385 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11708b6c-6a0c-457e-9d52-ccbd8844efd6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:43.770588 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:43.771260 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:43.771540 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:43.771812 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:43.781669 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:43.783098 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:43.792744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1423/2852] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:44.091289 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:44.092881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:44.108003 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e291e-c46d-4469-91f1-1a02d9fd6b70 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:44.115684 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:44.116497 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:44.116861 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:44.117045 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] PATH_INFO: `/v3/projects/8bdf200ba70043ccad354aae6f6cb4c2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:44.118409 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdf200ba70043ccad354aae6f6cb4c2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:44.120391 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:44.175107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdf200ba70043ccad354aae6f6cb4c2', 'request_id': 'req-a4ea19ec-56a8-408b-a89d-acecb6218f7f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.187108 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdf200ba70043ccad354aae6f6cb4c2', 'request_id': 'req-a4ea19ec-56a8-408b-a89d-acecb6218f7f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.193256 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdf200ba70043ccad354aae6f6cb4c2', 'request_id': 'req-a4ea19ec-56a8-408b-a89d-acecb6218f7f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.206734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] The token cache is being invalidate because project 8bdf200ba70043ccad354aae6f6cb4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:44.207065 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.207995 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.209805 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1430/2853] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:44 2022] DELETE /identity/v3/projects/8bdf200ba70043ccad354aae6f6cb4c2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:44.214160 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:44.226502 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c04b5c-e351-4112-9aa9-d8a27bd9f2c6 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:44.290374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:44.291258 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:44.291543 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:44.291826 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] PATH_INFO: `/v3/users/a1f00250ff254013b7392c97bdcb166d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:44.293089 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f00250ff254013b7392c97bdcb166d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:44.295062 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:44.349968 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f00250ff254013b7392c97bdcb166d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.350618 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f00250ff254013b7392c97bdcb166d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.351234 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f00250ff254013b7392c97bdcb166d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.363721 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f00250ff254013b7392c97bdcb166d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.371617 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f923cd61-1c0f-4b5b-9d24-8bb07f45ca09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f00250ff254013b7392c97bdcb166d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.384906 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1424/2854] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:44 2022] DELETE /identity/v3/users/a1f00250ff254013b7392c97bdcb166d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:44.665271 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:44.666933 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:44.682784 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea19ec-56a8-408b-a89d-acecb6218f7f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:44.742850 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:44.743707 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:44.743993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:44.744270 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] PATH_INFO: `/v3/projects/642075aee633494fa61f78e879d320ba` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:44.745516 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642075aee633494fa61f78e879d320ba)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:44.747439 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:44.788602 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:44.799059 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642075aee633494fa61f78e879d320ba', 'request_id': 'req-9076fb8b-f1a7-4117-accd-f20b37958c77'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.807304 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642075aee633494fa61f78e879d320ba', 'request_id': 'req-9076fb8b-f1a7-4117-accd-f20b37958c77'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.813437 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642075aee633494fa61f78e879d320ba', 'request_id': 'req-9076fb8b-f1a7-4117-accd-f20b37958c77'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.825367 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] The token cache is being invalidate because project 642075aee633494fa61f78e879d320ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:44.825660 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.826381 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9076fb8b-f1a7-4117-accd-f20b37958c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:44.828610 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1431/2855] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:44 2022] DELETE /identity/v3/projects/642075aee633494fa61f78e879d320ba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:44.833697 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:44.834196 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:44.834307 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:44.854206 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:44.855420 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:44.881311 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:44.921261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1425/2856] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:44.930868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:44.931173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:44.931548 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:44.956094 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:44.957358 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:44.968818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1432/2857] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:30:44.973541 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:44.985972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f96a-dfb0-469c-9eb1-457d7610a544 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:44.991579 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:44.992236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:44.992539 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:44.992816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:44.993655 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:30:44.993891 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:44.995509 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.007938 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1426/2858] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:30:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:30:45.012726 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.022981 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db18fc-736b-4e02-88f6-e6282de44196 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.028233 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.028914 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.029205 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.029479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.030235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.032118 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.068305 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1433/2859] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:30:45 2022] POST /identity/v3/projects => generated 388 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:45.073034 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.084881 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0465-c1d5-4440-9a5e-979a69a650e4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.143964 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.144639 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.144928 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.145246 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.145945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.147885 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.173471 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1427/2860] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:30:45 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:45.177460 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.188565 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942dd4c-c9eb-4d18-b36a-b8631caca856 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.193816 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.194520 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.194827 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.195107 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.196006 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.197997 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.208378 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1434/2861] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:45 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:30:45.212646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.223100 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524902e-c863-4689-adbd-351ed222529c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.228433 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4d81-0134-4137-b6d6-6138814f577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.229087 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4d81-0134-4137-b6d6-6138814f577a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.229397 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4d81-0134-4137-b6d6-6138814f577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.229671 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4d81-0134-4137-b6d6-6138814f577a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.230401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4d81-0134-4137-b6d6-6138814f577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.231996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4d81-0134-4137-b6d6-6138814f577a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.242620 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1428/2862] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:45 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:45.247098 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.257555 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae77e54-cb90-43ea-963e-b59e7f49c4a7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.262447 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.263332 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.263607 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.263877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] PATH_INFO: `/v3/projects/6dc4fe30c3c14844a9ca1cfcff898a49/users/a1f93df500504296bb05d9f6aa364919/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.281394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc4fe30c3c14844a9ca1cfcff898a49, user_id=a1f93df500504296bb05d9f6aa364919, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.285537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.306769 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1435/2863] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:45 2022] PUT /identity/v3/projects/6dc4fe30c3c14844a9ca1cfcff898a49/users/a1f93df500504296bb05d9f6aa364919/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:45.320592 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.321060 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.321767 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.352992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] MFA Rules not processed for user `a1f93df500504296bb05d9f6aa364919`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:45.354240 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:45.423716 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1429/2864] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:30:45.428387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.495589 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105670fe-59fd-4b48-a657-9af2ba154615 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.500669 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.501322 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.501604 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.501876 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.502562 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.504482 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.533674 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1436/2865] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:30:45 2022] POST /identity/v3/projects => generated 388 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:45.540107 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.554015 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea949c-9b35-4be8-883f-943675c5fec1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.579120 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:45.616276 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.616959 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.617285 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.617568 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.618270 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.620201 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.642926 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1430/2866] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:30:45 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:45.646830 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.658355 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850e4ae-5aba-4556-934b-85a543edb422 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.663879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.664544 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.664823 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.665093 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.665863 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.667467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.678817 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1437/2867] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:45 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:45.683301 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.693955 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6eadff-3265-4d7e-bf08-97118da38e4a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.699033 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.699920 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.700197 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.700470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] PATH_INFO: `/v3/projects/ada460f08aef4630a4a4cb2a2c1be161/users/46ea3c41195a43b8bb45eca5d89669ef/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.715551 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada460f08aef4630a4a4cb2a2c1be161, user_id=46ea3c41195a43b8bb45eca5d89669ef, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.718835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.733944 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1431/2868] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:45 2022] PUT /identity/v3/projects/ada460f08aef4630a4a4cb2a2c1be161/users/46ea3c41195a43b8bb45eca5d89669ef/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:45.738173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.748484 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a3b94-ea9d-426b-9a9a-093233818499 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.782541 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:45.810920 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054786-6e95-4c12-8c9e-becd3b85c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.811655 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054786-6e95-4c12-8c9e-becd3b85c017 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.811937 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054786-6e95-4c12-8c9e-becd3b85c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.812214 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054786-6e95-4c12-8c9e-becd3b85c017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.812950 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38054786-6e95-4c12-8c9e-becd3b85c017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.814623 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38054786-6e95-4c12-8c9e-becd3b85c017 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.825494 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1438/2869] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:45 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:45.830086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.840927 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2e335-ebaa-4be1-940f-686f86ce37d8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:45.847521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:45.848426 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.848709 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.848986 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] PATH_INFO: `/v3/projects/ada460f08aef4630a4a4cb2a2c1be161/users/46ea3c41195a43b8bb45eca5d89669ef/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.851280 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada460f08aef4630a4a4cb2a2c1be161, user_id=46ea3c41195a43b8bb45eca5d89669ef, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:45.853991 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:45.865335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1432/2870] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:45 2022] PUT /identity/v3/projects/ada460f08aef4630a4a4cb2a2c1be161/users/46ea3c41195a43b8bb45eca5d89669ef/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:45.875680 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:45.875949 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:45.876215 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:45.909099 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] MFA Rules not processed for user `46ea3c41195a43b8bb45eca5d89669ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:45.910380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:45.983751 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1439/2871] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:45.995378 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:45.997456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:46.057890 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83616-f8e1-4da4-810c-e06982931214 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:46.062319 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21220617-10c7-4603-8b0b-2d6314cb4099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:46.062974 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21220617-10c7-4603-8b0b-2d6314cb4099 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:46.063267 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21220617-10c7-4603-8b0b-2d6314cb4099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:46.063566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21220617-10c7-4603-8b0b-2d6314cb4099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:46.073593 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21220617-10c7-4603-8b0b-2d6314cb4099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:46.075072 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21220617-10c7-4603-8b0b-2d6314cb4099 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:46.085453 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1433/2872] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:46.159518 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:46.228342 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b21e5-2a74-4f19-aa08-3389eb899a53 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:46.233913 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:46.234732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:46.235015 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:46.235294 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] PATH_INFO: `/v3/users/a1f93df500504296bb05d9f6aa364919` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:46.236566 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f93df500504296bb05d9f6aa364919)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:46.238547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:46.291402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f93df500504296bb05d9f6aa364919'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.300251 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.306543 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f93df500504296bb05d9f6aa364919'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.307803 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f93df500504296bb05d9f6aa364919'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.317879 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f93df500504296bb05d9f6aa364919'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.318630 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f93df500504296bb05d9f6aa364919'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.331922 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1440/2873] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:46 2022] DELETE /identity/v3/users/a1f93df500504296bb05d9f6aa364919 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:46.336782 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:46.337071 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:46.337402 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:46.363519 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:46.364723 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:46.438903 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1434/2874] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:46.450964 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:46.452649 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:46.513329 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a320-b216-4bb9-8297-6aa8f718cbd1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:46.518315 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:46.518976 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:46.519257 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:46.519556 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:46.532811 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:46.534302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:46.544057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1441/2875] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:46.818859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:46.820374 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:46.833951 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d4ad-f2b3-4693-b502-1b0ce1f3ff85 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:46.839529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:46.840532 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:46.840804 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:46.841086 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] PATH_INFO: `/v3/projects/6dc4fe30c3c14844a9ca1cfcff898a49` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:46.843008 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc4fe30c3c14844a9ca1cfcff898a49)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:46.845210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:46.866365 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:46.898861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc4fe30c3c14844a9ca1cfcff898a49', 'request_id': 'req-9a517334-7ba7-42d4-bac2-7036eae9a0f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.907425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc4fe30c3c14844a9ca1cfcff898a49', 'request_id': 'req-9a517334-7ba7-42d4-bac2-7036eae9a0f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.913373 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc4fe30c3c14844a9ca1cfcff898a49', 'request_id': 'req-9a517334-7ba7-42d4-bac2-7036eae9a0f0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.924643 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] The token cache is being invalidate because project 6dc4fe30c3c14844a9ca1cfcff898a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:46.924997 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.926500 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:46.928046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1435/2876] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:46 2022] DELETE /identity/v3/projects/6dc4fe30c3c14844a9ca1cfcff898a49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:30:46.932085 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:46.942766 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2b96e-87a7-4567-9d2e-7b50217e7feb service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.025191 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.026100 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.026360 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.026634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] PATH_INFO: `/v3/users/46ea3c41195a43b8bb45eca5d89669ef` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.027862 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ea3c41195a43b8bb45eca5d89669ef)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.029912 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:47.084877 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ea3c41195a43b8bb45eca5d89669ef'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.097853 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ea3c41195a43b8bb45eca5d89669ef'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.098559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ea3c41195a43b8bb45eca5d89669ef'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.108111 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ea3c41195a43b8bb45eca5d89669ef'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.108732 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d62ac402-30bf-4285-a7c2-b7063e1e8949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ea3c41195a43b8bb45eca5d89669ef'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.116534 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:47.121731 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1442/2877] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:46 2022] DELETE /identity/v3/users/46ea3c41195a43b8bb45eca5d89669ef => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:47.429816 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:47.431291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:47.444425 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517334-7ba7-42d4-bac2-7036eae9a0f0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.504835 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.505698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.505981 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.506255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] PATH_INFO: `/v3/projects/ada460f08aef4630a4a4cb2a2c1be161` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.507526 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada460f08aef4630a4a4cb2a2c1be161)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.509575 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:47.558030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada460f08aef4630a4a4cb2a2c1be161', 'request_id': 'req-d636c911-c083-425b-b9f2-97436edf032e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.568564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada460f08aef4630a4a4cb2a2c1be161', 'request_id': 'req-d636c911-c083-425b-b9f2-97436edf032e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.575412 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada460f08aef4630a4a4cb2a2c1be161', 'request_id': 'req-d636c911-c083-425b-b9f2-97436edf032e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.587437 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] The token cache is being invalidate because project ada460f08aef4630a4a4cb2a2c1be161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:47.587744 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.588522 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d636c911-c083-425b-b9f2-97436edf032e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:47.590467 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1436/2878] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:47 2022] DELETE /identity/v3/projects/ada460f08aef4630a4a4cb2a2c1be161 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:47.595762 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.596057 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.596335 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.617706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:47.618947 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:47.685402 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1443/2879] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:47.693608 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.693886 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.694167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.715006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:47.716236 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:47.725038 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1437/2880] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:30:47.729590 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:47.740539 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126430fa-64fc-4c59-84ea-447800082a8a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.746280 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.746957 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.747246 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.747522 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.748243 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:30:47.748581 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.750301 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:47.762702 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1444/2881] 10.222.0.113 () {58 vars in 1158 bytes} [Mon Jul 25 19:30:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:30:47.766992 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:47.777275 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66843-bd79-440b-a73f-7447c9d0531b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.782730 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.783389 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.783675 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.783954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.784661 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.786610 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:47.817419 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1438/2882] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:30:47 2022] POST /identity/v3/projects => generated 382 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:47.822007 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:47.834364 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f31bb-c9ae-4829-9a27-fd1946709725 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.903403 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.904173 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.904456 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.904743 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.906044 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.907991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:47.929142 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1445/2883] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:30:47 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:30:47.933371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:47.944587 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fb37-21ff-486d-9b96-3fa7300e3f8b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.950379 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.951046 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.951335 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.951609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.952436 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.954099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:47.955346 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:47.969111 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1439/2884] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:47 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:47.970340 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:47.980868 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fcad-b1ad-4e04-84db-3f710d5a77a6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:47.986314 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7423-c2c6-4132-a2dd-75fb34782bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:47.987002 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7423-c2c6-4132-a2dd-75fb34782bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:47.987309 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7423-c2c6-4132-a2dd-75fb34782bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:47.987583 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7423-c2c6-4132-a2dd-75fb34782bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:47.988321 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7423-c2c6-4132-a2dd-75fb34782bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:47.990051 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7423-c2c6-4132-a2dd-75fb34782bcb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.001527 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1446/2885] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:47 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:48.005860 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.017013 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa14f91-94a8-4aef-9943-6e9332c282c6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.023372 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.024284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.024564 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.024839 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] PATH_INFO: `/v3/projects/9b71017beba4475f9c1ddb4f8288c492/users/1f6afa35a9e94d9aae6740ed7dbe99e5/roles/48a5339c8e664d73b4d1667aa69648a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.040982 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b71017beba4475f9c1ddb4f8288c492, user_id=1f6afa35a9e94d9aae6740ed7dbe99e5, role_id=48a5339c8e664d73b4d1667aa69648a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.043740 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.060271 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1440/2886] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:48 2022] PUT /identity/v3/projects/9b71017beba4475f9c1ddb4f8288c492/users/1f6afa35a9e94d9aae6740ed7dbe99e5/roles/48a5339c8e664d73b4d1667aa69648a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:30:48.081174 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.081429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.081706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.116248 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] MFA Rules not processed for user `1f6afa35a9e94d9aae6740ed7dbe99e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:48.117491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:48.172657 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:48.183561 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1447/2887] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:48.188035 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.265659 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9aa12-96e4-49a1-b981-2a086adea541 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.270870 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.271573 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.271859 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.272134 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.272838 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.274768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.304099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1441/2888] 10.222.0.113 () {60 vars in 1158 bytes} [Mon Jul 25 19:30:48 2022] POST /identity/v3/projects => generated 382 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:48.308432 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.321790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b16e1-cddf-4434-b297-887d439fd6cb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.384087 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.384790 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.385075 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.385387 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.386091 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.388046 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.410885 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1448/2889] 10.222.0.113 () {60 vars in 1149 bytes} [Mon Jul 25 19:30:48 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:30:48.414937 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.425775 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ac60b-8ced-4f82-8b17-a0f0d4d9cebb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.430687 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.431411 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.431666 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.432006 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.432776 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.434513 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.445975 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1442/2890] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:48 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:48.450970 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.461691 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95ed17-28e7-4266-9a40-c51a63691368 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.467376 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.468380 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.468668 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.468931 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] PATH_INFO: `/v3/projects/5c555049daf646f58ffaaaa0a8dee758/users/e9cb7aa3292a47cc95fcb74d902130fb/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.616601 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c555049daf646f58ffaaaa0a8dee758, user_id=e9cb7aa3292a47cc95fcb74d902130fb, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.621005 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.643958 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1449/2891] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:48 2022] PUT /identity/v3/projects/5c555049daf646f58ffaaaa0a8dee758/users/e9cb7aa3292a47cc95fcb74d902130fb/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:48.648613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.659764 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99435db0-e937-4537-8559-8316a9c7f001 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.726127 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953502d-59f2-4145-b627-0cf96d24b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.726865 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953502d-59f2-4145-b627-0cf96d24b3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.727148 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953502d-59f2-4145-b627-0cf96d24b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.727424 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953502d-59f2-4145-b627-0cf96d24b3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.728155 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953502d-59f2-4145-b627-0cf96d24b3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.729823 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953502d-59f2-4145-b627-0cf96d24b3ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.740167 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1443/2892] 10.222.0.113 () {58 vars in 1127 bytes} [Mon Jul 25 19:30:48 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:30:48.746222 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.757182 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf2262-1940-4716-a5ca-dff557862561 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.762268 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.763166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.763458 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.763734 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] PATH_INFO: `/v3/projects/5c555049daf646f58ffaaaa0a8dee758/users/e9cb7aa3292a47cc95fcb74d902130fb/roles/6a0cf49bc31549b3b4c741ce358913de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.766471 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c555049daf646f58ffaaaa0a8dee758, user_id=e9cb7aa3292a47cc95fcb74d902130fb, role_id=6a0cf49bc31549b3b4c741ce358913de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.769090 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:48.780476 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1450/2893] 10.222.0.113 () {60 vars in 1488 bytes} [Mon Jul 25 19:30:48 2022] PUT /identity/v3/projects/5c555049daf646f58ffaaaa0a8dee758/users/e9cb7aa3292a47cc95fcb74d902130fb/roles/6a0cf49bc31549b3b4c741ce358913de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:48.792238 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.792553 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.792861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.824934 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] MFA Rules not processed for user `e9cb7aa3292a47cc95fcb74d902130fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:48.826210 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:48.857700 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:48.900615 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1444/2894] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:48.912273 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:48.914765 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:48.975993 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7bf9e-8807-45c7-921a-1974e224541b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:48.980028 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bccd7-b93d-4cc7-ba52-8417ac0f9b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59220145172c436b8995414a68d94bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:48.980706 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bccd7-b93d-4cc7-ba52-8417ac0f9b0c service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:48.980965 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bccd7-b93d-4cc7-ba52-8417ac0f9b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:48.981282 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bccd7-b93d-4cc7-ba52-8417ac0f9b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:48.991908 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bccd7-b93d-4cc7-ba52-8417ac0f9b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:48.993420 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bccd7-b93d-4cc7-ba52-8417ac0f9b0c service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:49.003906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1451/2895] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:49.400051 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:49.464291 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b946a-5105-4c34-8726-e3f22055d132 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:49.469609 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:49.470485 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:49.470768 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:49.471042 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] PATH_INFO: `/v3/users/1f6afa35a9e94d9aae6740ed7dbe99e5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:49.472273 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6afa35a9e94d9aae6740ed7dbe99e5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:49.474231 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:49.527954 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6afa35a9e94d9aae6740ed7dbe99e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:49.528631 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6afa35a9e94d9aae6740ed7dbe99e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:49.529296 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6afa35a9e94d9aae6740ed7dbe99e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:49.541344 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6afa35a9e94d9aae6740ed7dbe99e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:49.549861 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6afa35a9e94d9aae6740ed7dbe99e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:49.562354 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1445/2896] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:49 2022] DELETE /identity/v3/users/1f6afa35a9e94d9aae6740ed7dbe99e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:49.567818 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:49.568230 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:49.568559 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:49.596221 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] MFA Rules not processed for user `a8b8b54dcb4240b68176774c2828e299`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:30:49.597394 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:49.641815 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:49.659694 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1452/2897] 10.222.0.113 () {58 vars in 963 bytes} [Mon Jul 25 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:30:49.669549 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:49.671076 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:49.725585 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:49.732138 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d032-41c7-4647-9c5d-6828134765ea admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:49.737941 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:49.738748 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:49.739099 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:49.739555 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:49.749371 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:49.750887 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:49.760351 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1446/2898] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:30:50.054281 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:50.056532 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:50.072550 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d7b9-d6b7-4e7b-a16d-2c6060705101 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:50.078919 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:50.079889 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:50.080235 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:50.080567 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] PATH_INFO: `/v3/projects/9b71017beba4475f9c1ddb4f8288c492` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:50.082325 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b71017beba4475f9c1ddb4f8288c492)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:50.084284 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:50.133498 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b71017beba4475f9c1ddb4f8288c492', 'request_id': 'req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.142991 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b71017beba4475f9c1ddb4f8288c492', 'request_id': 'req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.149066 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b71017beba4475f9c1ddb4f8288c492', 'request_id': 'req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.162678 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] The token cache is being invalidate because project 9b71017beba4475f9c1ddb4f8288c492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:50.163052 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.164055 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.166881 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1453/2899] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:50 2022] DELETE /identity/v3/projects/9b71017beba4475f9c1ddb4f8288c492 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:50.171007 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:50.181284 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00065a-ed9b-469f-b59b-0704166a369a service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:50.252689 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:50.253531 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:50.253808 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:50.254079 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] PATH_INFO: `/v3/users/e9cb7aa3292a47cc95fcb74d902130fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:50.255279 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cb7aa3292a47cc95fcb74d902130fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:50.257268 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:50.307345 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cb7aa3292a47cc95fcb74d902130fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.308005 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cb7aa3292a47cc95fcb74d902130fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.308668 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cb7aa3292a47cc95fcb74d902130fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.320278 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cb7aa3292a47cc95fcb74d902130fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.329529 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f50f81cb-d4ed-41a3-84dc-04396d268231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cb7aa3292a47cc95fcb74d902130fb'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.342036 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1447/2900] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:30:50 2022] DELETE /identity/v3/users/e9cb7aa3292a47cc95fcb74d902130fb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:30:50.664479 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:30:50.666313 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:30:50.680820 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9bfab-75c2-4cfb-8fdc-d62d29b8d8d9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:30:50.750269 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:30:50.751158 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:30:50.751434 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:30:50.751703 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] PATH_INFO: `/v3/projects/5c555049daf646f58ffaaaa0a8dee758` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:30:50.752988 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c555049daf646f58ffaaaa0a8dee758)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:30:50.754956 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:30:50.810365 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c555049daf646f58ffaaaa0a8dee758', 'request_id': 'req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.819857 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c555049daf646f58ffaaaa0a8dee758', 'request_id': 'req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.826036 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c555049daf646f58ffaaaa0a8dee758', 'request_id': 'req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.842741 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] The token cache is being invalidate because project 5c555049daf646f58ffaaaa0a8dee758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:30:50.842999 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.843921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b43e66cc-4dfd-48f4-87e3-be19fe56f75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:30:50.845662 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1454/2901] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:30:50 2022] DELETE /identity/v3/projects/5c555049daf646f58ffaaaa0a8dee758 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:31:00.338893 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:00.839153 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:05.221466 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b006bf-d08b-49ff-bea9-f66e90f3505c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:31:05.222044 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b006bf-d08b-49ff-bea9-f66e90f3505c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:31:05.222227 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b006bf-d08b-49ff-bea9-f66e90f3505c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:31:05.223876 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1448/2902] 10.222.0.113 () {54 vars in 926 bytes} [Mon Jul 25 19:31:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:31:05.230144 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:31:05.230667 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:31:05.230788 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:31:05.273292 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] MFA Rules not processed for user `b58dcd8f33cb40fc9580af1fa294e369`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:31:05.274546 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:31:05.330171 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1455/2903] 10.222.0.113 () {58 vars in 1023 bytes} [Mon Jul 25 19:31:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:31:05.343790 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b006bf-d08b-49ff-bea9-f66e90f3505c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:31:05.345688 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-44b006bf-d08b-49ff-bea9-f66e90f3505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:31:05.363482 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b006bf-d08b-49ff-bea9-f66e90f3505c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:31:05.367841 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b58dcd8f33cb40fc9580af1fa294e369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:31:05.368521 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:31:05.368802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:31:05.369052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:31:05.376915 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:31:05.378972 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:31:05.386847 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1449/2904] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:31:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:31:05.525906 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:31:05.528467 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:31:05.622621 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a7c35-4887-4fb8-a512-9d00fa135b6e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:31:05.629009 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:31:05.629687 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:31:05.629961 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:31:05.630442 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:31:05.632198 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:31:05.643894 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:31:05.645491 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:31:05.655634 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1456/2905] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:31:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:31:08.239603 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:31:08.241452 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:31:08.329293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd68e7c-2a34-4924-b7e7-9901795499f1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:31:08.335115 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:31:08.335802 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:31:08.336085 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:31:08.336364 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:31:08.338286 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:31:08.350817 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:31:08.352456 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:31:08.363578 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1450/2906] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:31:15.651777 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=61 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:31:18.358888 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=40 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:24.000742 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:32:24.002537 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:24.022218 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cccc5-8e40-4557-ab94-92e9d819bbbf service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:32:24.028445 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15cfb6d527464ccaad7db841e3eacf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:32:24.029757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:32:24.029757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:32:24.029757 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:32:24.031749 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:24.045302 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:32:24.047095 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:32:24.060121 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1457/2907] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:32:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:32:34.054519 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:34.192613 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:32:34.194580 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:34.264795 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b470e-209d-479b-89ca-1dbc82532b12 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:32:34.269646 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:32:34.270538 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:32:34.270829 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:32:34.271109 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] PATH_INFO: `/v3/users/2e55553f8a6d4c9fbc1954bb761b5cf5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:32:34.272367 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e55553f8a6d4c9fbc1954bb761b5cf5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:32:34.274332 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:32:34.329259 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e55553f8a6d4c9fbc1954bb761b5cf5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.329970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e55553f8a6d4c9fbc1954bb761b5cf5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.330695 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e55553f8a6d4c9fbc1954bb761b5cf5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.351711 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e55553f8a6d4c9fbc1954bb761b5cf5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.359996 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e55553f8a6d4c9fbc1954bb761b5cf5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.372852 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1451/2908] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:32:34 2022] DELETE /identity/v3/users/2e55553f8a6d4c9fbc1954bb761b5cf5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:32:34.564586 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:32:34.576531 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556582-1987-48b1-a2ac-536a6baa1efe service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:32:34.638047 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:32:34.638921 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:32:34.639196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:32:34.639468 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] PATH_INFO: `/v3/projects/c8a3878f16a345ec95296001dde3a933` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:32:34.640692 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a3878f16a345ec95296001dde3a933)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:32:34.642622 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:32:34.691104 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a3878f16a345ec95296001dde3a933', 'request_id': 'req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.701776 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a3878f16a345ec95296001dde3a933', 'request_id': 'req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.712203 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a3878f16a345ec95296001dde3a933', 'request_id': 'req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.729429 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] The token cache is being invalidate because project c8a3878f16a345ec95296001dde3a933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:32:34.729644 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.730415 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.732101 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1458/2909] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:32:34 2022] DELETE /identity/v3/projects/c8a3878f16a345ec95296001dde3a933 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:32:34.736562 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:32:34.738261 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:34.751566 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc045-b77d-4f9b-ab4c-37b904ebd673 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:32:34.812470 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:32:34.813401 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:32:34.813693 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:32:34.813970 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] PATH_INFO: `/v3/users/8ef4dbd3d24642e1b9fa4094d5f6dee7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:32:34.815255 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef4dbd3d24642e1b9fa4094d5f6dee7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:32:34.817342 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:32:34.840486 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:34.870045 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef4dbd3d24642e1b9fa4094d5f6dee7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.870698 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef4dbd3d24642e1b9fa4094d5f6dee7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.871293 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef4dbd3d24642e1b9fa4094d5f6dee7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.882945 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef4dbd3d24642e1b9fa4094d5f6dee7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.892052 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef4dbd3d24642e1b9fa4094d5f6dee7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:34.905417 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1452/2910] 10.222.0.113 () {58 vars in 1229 bytes} [Mon Jul 25 19:32:34 2022] DELETE /identity/v3/users/8ef4dbd3d24642e1b9fa4094d5f6dee7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:32:35.090547 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:32:35.092022 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:35.105502 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b429b-c2b9-40b8-bf8a-9d132439ad5e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:32:35.162285 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b8b54dcb4240b68176774c2828e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b55401b6f7164ec1b40688c01754b91f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:32:35.163166 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:32:35.163443 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:32:35.163711 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] PATH_INFO: `/v3/projects/182670592a4b4de9adf8161c66d07c34` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:32:35.165070 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182670592a4b4de9adf8161c66d07c34)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:32:35.167038 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:32:35.204419 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:35.218787 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182670592a4b4de9adf8161c66d07c34', 'request_id': 'req-dd236c99-410b-4b46-a85f-9f5bead6f023'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:35.228195 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182670592a4b4de9adf8161c66d07c34', 'request_id': 'req-dd236c99-410b-4b46-a85f-9f5bead6f023'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:35.233725 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182670592a4b4de9adf8161c66d07c34', 'request_id': 'req-dd236c99-410b-4b46-a85f-9f5bead6f023'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:35.245483 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] The token cache is being invalidate because project 182670592a4b4de9adf8161c66d07c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:32:35.245909 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:35.246624 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dd236c99-410b-4b46-a85f-9f5bead6f023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:32:35.248196 dv-cinder-850939-1-smb devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1459/2911] 10.222.0.113 () {58 vars in 1238 bytes} [Mon Jul 25 19:32:35 2022] DELETE /identity/v3/projects/182670592a4b4de9adf8161c66d07c34 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:32:44.901803 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:45.242829 dv-cinder-850939-1-smb devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:33:14.844265 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:33:14.846019 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:33:14.922912 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f5a20-dfe5-48de-9761-64a461acecf7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:33:14.992751 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24596930fed646f6ba8ea30e43dbbcfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e64fcc04df04f97955525386c90a40e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:33:14.993432 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:33:14.993714 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:33:14.993989 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:33:14.996030 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:33:15.008241 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:33:15.009958 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d2059-cdf4-4566-a94f-a8ce15b74a5a service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:33:15.021377 dv-cinder-850939-1-smb devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1453/2912] 10.222.0.113 () {60 vars in 1370 bytes} [Mon Jul 25 19:33:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:33:25.017024 dv-cinder-850939-1-smb devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=58 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}